AFFDL-TR-78-86 


THE  DESIGN  OF  AN  OPTIMAL  OBSERVER  FOR 
LINEAR  DISCRETE-TIME  DYNAMICAL  SYSTEMS 


AIR  FORCE  FLIGHT  DYNAMICS  LABORATORY 
AIR  FORCE  WRIGHT  AERONAUTICAL  LABORATORIES 
AIR  FORCE  SYSTEMS  COMMAND 
WRIGHT-PATTERSON  AIR  FORCE  BASE,  OHIO  45433 


UNIVERSITY  OF  CALIFORNIA,  LOS  ANGELES 
SCHOOL  OF  ENGINEERING  AND  APPLIED  SCIENCE 
7620  BOELTER  HALL,  UCLA 
LOS  ANGELES,  CALIFORNIA  90024 


TECHNICAL  REPORT  AFFDL-TR-78-86 
Final  Report  for  Period  1977-1978 


July  1978 


Approved  for  public  release;  distribution  unlimited. 


SECURITY  CLASSIFICATION  OF  THIS  RAGE  (IFh an  Data  E.Mjrad) 


W REPORT  DOCUMENTATION  PAGE 


AFFDLWTR-78-86 


' / |«  TITLE  fan*  SuhUtlai J 

Up  I JHE  RESIGN  OF  AN  jJPTIMAL  OBSERVER  FOR  J.INEAR  / 
1/  DISCRETE  TIME  DYNAMICAL  SYSTEMS,  ^ J 


Sire  READ  INSTRUCTIONS 

BEFORE  COMPLETING  FORM 

2.  GOVT  ACCESSION  NO.  1.  RECIPIENT'S  CATALOG  NUMBER 


17.  AUTHORC*.) 


(10  DU  M./ Novak  f 2d) 

(C.  T./ Leondes^  Principal  Investigator) 

S.  PERFORMING  ORGANIZATION  NAME  AND  ADDRESS 

School  of  Engineering  and  Applied  Science 

University  of  California,  Los  Angeles 

Los  Angeles,  CA  90024 ] 

II  CONTROLLING  OFFICE  NAME  AND  ADORESS  

Air  Force  Flight  Dynamics  Laboratory  (FGL)  , jj 
Wright-Patterson  AFB,  Ohio  45433 

M MONITORING  AGENCY  NAME  * AODRESSflf  dlllarant  treat  Coot.r'tln,  Otfica) 

Office  of  Naval  Research  " ' ~ y 

1030  E.  Green  Street  /Ji  J ( J ~~pt  j 

Pasadena,  CA  91106  ~ [ — 

Attention:  Mr.  Perry  Beilke 

IS  OISTRIEUTION  STATEMENT  (ol  thla  Raporl) 


S.  TYPE  OF  REPORT  • PERIOD  COVERED 

5/77  5/78 

S.  PERFORMING  ORg7  REPORT  NUMBER 

t.  contract  or  grant  numbers; 

7 ?PT 

( F j3615-77-C-y)13^  ^ 

10.  PROGRAM  ELEMENT.  PROJECT,  TASK 
AREA  BJEQRK  UNIT  NUMBERS 

ii^W02 

/4>  ,jf7) 

'*  _REF25UlAXt  . 

V Jul^»78  / 

'IS.  NUMBER  of  pages 
108 

IS.  SECURITY  CLASS,  (ol  thla  raport) 

Unclassified 


IS*.  DECLASSIFICATION/OOWNORAOING 
SCHEDULE 


\ppnved  for  public  release;  distribution  unl.mited. 


17.  DISTRIBUTION  STATEMENT  (of  ffi«  abatract  entered  In  Block  20,  II  dllloront  from  Report) 


| It.  KEY  WORDS  (Continue  on  reeeree  elde  II  neceeeary  and  Identity  by  block  number) 


Estimation  Theory,  Minimal  Order  Observer,  Optimal  Observer 

s-v 

^ ABSTRACT  ( Continue  on  reverie  elde  II  neceeeary  and  Identity  by  block  number) 

This  report  investigates  the  idea  of  utilizing  Luenberger's  minimal -order 
observer  as  an  alternate  to  the  Kalman  filter  for  obtaining  state  estimates 
in  linear  discrete  time  stochastic  systems.  More  specifically,  this 
dissertation  presents  a solution  to  the  problem  of  construction  as  optimal 
minimal  order  observer  for  linear  discrete  time  stochastic  systems  where 
optimality  is  in  the  mean  square  sense.  The  approach  taken  in  this  report 
leads  to  a completely  unified  theory  for  the  design  of  optimal  minimal -order 
observers  and  is  applicable  to  both  time-varying  and  time- invariant  linear  sys'  ems. 

DD  1 JAN*?*  1473  EDITION  OF  I NOV  SS  IS  OBSOLETE 


SECURITY  CLASSIFICATION  OF  THIS  PAGE  (Whao  Data  Entarad) 

'/:'•/  7 5f 


SECURITY  CLMII>lC>T;aw  or  THIS  PXOlfWSl  Dgl 


The  basic  solution  to  the  problem  is  first  obtained  for  the  class  of  systems 
having  Gaussian  white  noise  disturbances.  The  solution  is  based  on  a special 
linear  transformation  which  transforms  the  given  time-varying  discrete-time 
state  equations  into  an  equivalent  state  space  which  is  extremely  convenient 
from  the  standpoint  of  observer  design.  Design  of  the  observer  is  based  on  a 
special  observer  configuration  containing  a free  gain  matrix  Kj,  which  is  chosen) 
to  minimize  the  mean-square  estimation  error  at  time  "i".  The  solution  obtained 
is  optimal  at  each  instant  "i"  and  therefore  is  optimal  both  during  the  transient 
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is  much  simpler  than  for  the  Kalman  filter.  In  the  special  case  of  no  measure- 
ment noise,  the  observer  estimation  errors  are  identical  with  those  of  the 
corresponding  Kalman  filter.  When  measurement  noise  is  not  excessive,  estimation 
errors  comparable  with  a Kalman  filter  are  obtained. 

Next,  the  basic  observer  solution  is  extended  to  the  class  of  systems  for  which 
the  noise  disturbances  are  time  wise  correlated  processes  of  the  Gauss-Markov 
type.  In  considering  the  correlated  noise  inputs,  the  basic  observer  structure 
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j^of  the  state  vector. 
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in  the  domain  of  observer  theory. 
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PREFACE 


For  many  Air  Fore*  flight  dynamic  vahicla  problems  it  is  absolutely 
essential  to  utilise  effective  filtering  techniques.  This  includes  such 
issues  as  ride  control.  most  effective  flight  vehicle  systems  instrumentation 
utilisation,  etc.  One  of  the  most  important  areas  for  such  techniques  is 
that  of  observers,  and  this  report  presents  ohe  of  the  most  densely  rich 
collection  of  results  to  be  published  to  date  on  the  national  scene. 
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SECTION  I 


INTRODUCTION  AND  OUTUNB  OF  RBSBARCH 

1 . 1 INTRODUCTION  AND  PROBLEM  STATEMENT 

The  general  state  estimation  problem  to  be  considered  In  this 
dissertation  is  described  simply  as  follows.  Given  the  linear  stochastic 
discrete* time  dynamical  system  characterized  by  the  equations 

il+l'Vl+St  d.i) 

1,*  «!»,  + »,  (1.2) 

where 

Xj  is  the  n-dimensional  state  vector 

^ is  the  m-dimenslonal  measurement  vector 

w,  and  Vj  are,  respectively,  n-dlmenslonal  and  m*dlmensional 

independent  Gaussian  white  noise  sequences  having  zero  means  and 

covariances  Qj  and  R. 

ttnd  Xy,  the  initial  state,  is  an  independent  Gaussian  vector  with  mean  ^ 
and  covariance  Mq.  It  is  desired  to  find  an  estimate  of  the  state  vector  Xj  at 
time  "i"  along  with  its  associated  error  covariance  P^.  The  notation 

tk 

— i/i  *mP^es  estimate  is  to  be  based  on  all  the  measurements  obtained 
up  to  and  including^  obtained  at  time  "i."  It  is,  of  course,  also  desired 
that  this  estimate  be  optimal  in  some  sense,  - i.e.,  with  respect  to  some 
given  periormance  criterion.  There  are  many  performance  criteria  which 
have  been  presented  in  the  literature  pertaining  to  estimation  theory, 
however,  from  the  standpoint  of  mathematical  tractabllity  the  quadratic 
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performance  criterion  is  most  appealing  and  it  was  this  performance 
criterion  which  was  used  quite  successfully  by  Kalman  [14].  If  it  is 
desired  that  the  estimate  x^  be  optimal  in  the  mean-square  sense,  which 
implies  thut  the  estimate  x^  minimizes  the  quantity  E t||x^j*XjlP} 
then  the  solution  to  the  estimation  problem  is  the  well-known  Kalman  filter 
and  the  defining  equations  for  the  optimal  Kalman  estimator  are 


A A 1/  / A 

-i+l/i+1  = -i+l/i  + Kl+l^l+l  ‘ Hi+i-l+l/i> 


K i+1  = Pi+l/i  Hi+1  (Hl+lPl+l/iHi+l # + Ri+1> 


P i+l/i  = AiPi/iAi  + ^i 


Pi+l/i+l  = ®n  ' Ki+lHi+P  Pi+l/i 


(1.3) 

(1.4) 

(1.5) 

(1.6) 


where  x.+1^.  = A.x^.  To  initialize  the  Kalman  filter  at  time  "i=0"  we  take 

x , = x and  P . = M . 

-o/o  — o o/o  o 

Although  in  theory  the  Kalman  filter  completely  solves  the  problem 
of  state  estimation  in  the  mean-square  sense  for  linear  systems  with 
Gaussian  statistics,  its  inherent  complexity  and  implementation  have 
discouraged  widespread  application.  Building  the  Kalman  filter  essentially 
requires  the  simulation  of  the  entire  n-dimensional  system  being  observed. 
Equally  important,  the  Ricatti  equations  (1.5)  and  (1.6)  which  must  be 
solved  at  each  time  instant  "l"  to  obtain  the  optimal  Kalman  gain  matrix,  K^, 
have  been  the  source  of  much  trouble  in  the  real-time  mechanization  of 
Kalman  filters,  especially  in  the  case  of  large  dimensional  systems.  These 
numerical  and  computational  problems  associated  with  the  real-time 
implementation  of  Kalman  filters  have  led  many  researchers  to  seek  out 
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simpler,  less  optimal  solutions  to  the  minimum  mean-square  state 
estimation  problem. 

Early  work  in  this  a.  -a  was  done  by  Luenberger  [20-22]  who  showed 
that  when  the  system  (1.1)  and  (1.2)  is  time -invariant  and  no  noise  distur- 
bances are  present,  the  state  vector  Xj  may  be  reconstructed  exactly  with  a 
stable  linear  system  of  order  "n-m"  which  he  called  a minimal-order 
observer . Luenberger's  basic  idea  in  the  development  of  his  minimal-order 
observer  is  the  notion  that  since  there  are  "m"  independent  measurements 
already  available  it  should  be  possible  to  reconstruct  the  entire  n-dimensional 
state  vector  of  the  system  by  generating  only  "n-m"  additional  quantities  and 
combining  them  appropriately  with  the  "m”  already  existing  outputs.  Of 
course,  Luenberger's  basic  assumption  that  the  system  inputs  are  free  of 
noise  is  not  always  satisfied  in  practice  and  this  comprises  a fundamental 
limitation  to  his  original  work. 

Next,  Aoki  and  Huddle  [3  ] extended  Luenberger's  work  to  include  the 
effects  of  noise  disturbances  Wj  and  v. . However,  their  work  was  restricted 
to  time-invariant  systems  and  as  a result  their  technique  is  not  directly 
applicable  to  the  more  general  time-varying  system  modeled  in  (1.1)  and 
(1.2).  The  technique  presented  in  Aoki  and  Huddle  [3]  was  essentially  to 
construct  a minimal-order  observer  which  minimized  the  steady-state  mean- 
square  estimation  error.  However,  their  optimization  technique  is  compu- 
tationally formidable,  even  for  the  simplest  of  systems,  and  as  a result  does 
not  appear  to  have  been  used  to  any  large  degree  in  the  design  of  minimal- 
order  observers  for  practical  engineering  systems . 

Attempts  to  construct  optimal  observer  designs  based  on  a purely 
deterministic  point  of  view  also  appear  to  have  been  fruitless.  Newmann  [23] 
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has  investigated  the  standard  optimal  rontrol  problem  with  u quadratic  cost 
function  lor  the  case  of  linear  time* invariant  systems  using  an  observer  in 
the  feedback  path  when  some  of  the  state  variables  are  not  measurable.  By 
counterexample,  he  clearly  demonstrat  1 that  If  nothing  is  known  about  the 
initial  conditions  of  the  state  vector  then  there  is  no  way  of  designing  the 
observer  so  that  the  cost  of  control  will  be  minimized.  In  fact,  if  nothing 
is  known  about  the  initial  conditions  then  high  cost  may  result  from  the  use  of 
an  observer  in  the  feedback  path. 

Dellon  C 10  3 also  studied  the  deterministic  feedback  optimal  control 
problem  with  the  standard  quadratic  cost  function  from  the  standpoint  of  using 
a minimal-order  observer  in  the  feedback  to  reconstruct  the  state  vector  x. . 
Dellon  considered  the  more  general  time-varying  discrete  system  in  the 
absence  of  noise  disturbances  and  has  indicated  similar  findings.  Restricting 
his  observer  design  to  that  class  of  observers  having  constant  and  equal 
eigenvalues  he  concluded  that  the  relative  degradation  in  cost  from  the 
optimal  (i.e.,  when  all  the  states  are  available  for  feedback)  cannot  be  made 
arbitrarily  small  by  proper  choice  of  observer  eigenvalues  but  the  relative 
degradation  depends  upon  the  original  optimization  problem. 

More  recently,  Ash  [4,  5]  developed  a sub-optimal  minimal-order 
observer  estimator  design  applicable  to  both  discrete  and  continuous  time- 
varying  stochastic  systems.  His  main  goal  was  to  develop  a stable  minimal- 
order  observer  which  provided  "acceptable"  mean-square  estimation  errors. 
Ash  himself  stated  that  his  work  comprises  an  engineering  solution  rather 
than  a mathematical  solution  to  the  problem.  The  design  procedure  of  Ash 
is  a "trial  and  error"  technique  which,  if  judiciously  applied,  may  result  in  a 
relatively  good  sub-optimal  estimator  in  comparison  to  the  corresponding 
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optimal  Kalman  filter . However,  in  the  utilization  of  Ash's  "trial  and  error" 
technique  it  is  not  at  all  clear  how  to  achieve  acceptable  performance  without 
trying  many  designs  and  selecting  the  best  design  out  of  those  which  were 


tried  out. 

To  review  the  preceeding  paragraphs,  we  have  introduced  the 
fundamental  problem  of  minimum  mean-square  estimation  for  linear  discrete 
stochastic  systems  and  have  indicated  Kalman's  optimal  solution  under  the 
assumption  of  Gaussian  noise  processes.  After  describing  Kalman's  filter 
and  its  inherent  problems  of  computation  and  implementation  in  real-time 
systems,  we  next  considered  the  idea  of  using  Luenberger's  minimal-order 
observer  as  an  alternate  to  the  Kalman  filter.  The  evolution  of  Luenberger's 
basic  observer  theory  is  then  presented  through  a discussion  of  the  attempts 
of  various  researchers  to  design  observers  which  are  optimal  in  some  sense, 
both  from  a deterministic  control  theory  point  of  view  as  well  as  from  a more 
general  stochastic  estimation  theory  point  of  view.  Through  this  evolutionary 
discussion  we  have  attempted  to  provide  the  reader  with  a smooth  transition 

from  Luenberger's  original  concept  of  a minimal-order  observer  to  the  , ) 

ultimate  topic  of  this  dissertation.  It  should  be  clear  from  the  historical 

evolution  that  the  solution  for  an  optimal  minimal- order  observer  has 

importance  not  only  from  a theoretical  standpoint  but  also  from  the  standpoint 

of  designing  optimal  and  suboptimal  engineering  systems.  For  these  reasons, 

we  have  considered,  in  this  dissertation,  the  problem  of  constructing  an 

optimal  minimal-order  observer  for  discrete-time  stochastic  systems  and,  in 

the  spirit  of  Kalman,  have  chosen  the  mean -square  estimation  error  as  our 


performance  criterion. 


1.2  OUTLINli  Ot'  nili  WS.ShKTATlON 

Chapter  2 is  u present ut inn  ol  some  of  the  more  important  basic 
results  of  observer  theory  as  related  to  deterministic  discrete  time-varying 
systems.  Chapter  2 has  been  included  mainly  for  completeness  and  is 
intended  to  Introduce  the  reader  to  the  basics  of  observer  theory.  Those 
familiur  with  the  material  may  skip  Chapter  2 without  loss  of  continuity. 

New  theoretical  results  ure  given  in  Chapter  3,  in  which  is  presented 
the  iundamental  solution  for  the  optimal  minimal-order  observer  in  the 
case  where  the  noises  Wj  and  Vj  are  Gaussian  white  noise  sequences.  Also,  in 
Chapter  3 the  complete  generality  of  the  optimal  minimal-order  observer 
design  is  discussed  und  the  equivalence  of  this  observer  and  the  Kalman 
filter  is  demonstrated  for  the  speciul  case  in  which  the  measurement  noise, 
v.,  is  identically  zero.  Chapter  4 treats  important  new  extensions  of  the 
basic  minimal-order  observer  design  to  the  class  of  systems  in  which  the 
noise  disturbances  Wj,  v(  are  time-wise  correlated  processes  of  the  Gauss* 
Markov  type. 

A comprehensive  and  comparative  study  of  several  observer  designs, 
including  the  Kalman  filter,  the  optimal  minimal-order  observer,  and 
several  equal  eigenvalue  observer  designs,  is  presented  in  the  examples  of 
Chapter  5.  The  computer  simulations  of  Chapter  5 treat  the  practical 
problem  of  designing  a radar  tracking  system  of  reduced  complexity  iiased  on 
the  optimal  minimal-order  observer  solutions  developed  in  the  previous 
chapters  3 and  4 of  the  dissertation. 

The  final  conclusions  and  recommendations  for  further  research  are 


presented  in  Chapter  6 


SECTION  II 


SOW  FUNDAMENTAL  RESULTS  OF  DETERMINISTIC 
OBSERVER  THEORY 


2.1  MINIMAL-ORDER  OBSERVERS  FOR  DETERMINISTIC  SYSTEMS 

The  purpose  of  this  chapter  Is  to  review  some  of  the  more  important 
fundamental  results  of  deterministic  observer  theory  which  have  been 
obtained  by  various  researchers  to  date.  We  begin  by  defining  the  concept  of 
a minimal-order  observer  for  linear  discrete-time  dynamical  systems. 
Huddle  [13]  has  shown  that  a completely  observable  n-dlmenslonal  system 


-i+1  = A A + Bi^i 


(2.1) 


with  m independent  outputs 

i,  * HA 

can  be  ’’observed”  with  an  (n-m)-dimenslonal  system 
-i+1  = F A + CiHi  + Di*t 

such  that  the  output  of  the  observer  is  of  the  form 
—i  * Ti~i  +ii 

where 


(2.2) 


(2.3) 


(2.4) 


(2.5) 
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If  the  observer  Initial  condition  is  chosen  such  that  * T x then 

— o o—o 

from  (2.4),  (2.5)  it  is  seen  that  Zj  * T^  for  all  "1"  * 0 and  in  this  case  it 
is  possible  to  reconstruct  x,  exactly  from  y,  and  z. , The  observer  is  chosen 

r Ti  i 

so  that  the  rows  of  J are  linearly  Independent  and  the  estimate  of  Xj  is 
taken  as 


*TT 


If  z^  * Tt>x0  t*len  will  give  the  true  value  of  the  state  x^. 

Huddle  also  proved  that  for  the  system  (2.3)  to  be  an  observer  of  the 
state  In  (2.1)  it  is  both  necessary  and  sufficient  that  the  following  matrix 
relations  be  satisfied 


TmAi  * FiTi  + DiHi 


Gi  = Ti+iBi 

rTi  t* 

Further,  since  it  is  necessary  that  the  matrix  Inverse  exist, 


Huddle  postulated  the  Inverse  to  be  partitioned  in  the  form  CPj  | Vt  ] and 


obtained  the  solution  of  (2.7)  to  be 


Fi  = Tl+lAlPl 


Di  = Ti+lAiVi 


(2.W) 


where  P^Tj  + V^H^  ■ 1. 

By  using  a clever  coordinate  transformation  Dellon  C 10 1 next 
extended  the  work  of  Huddle  by  proving  that  the  eigenvalues  of  the  observer 
matrix  Fj  are  completely  arbitrary  provided  the  system  (2.1)  is  completely 
uniformly  observable.  To  do  this  Dellon  assumed  the  measurement  matrix 


to  bo  of  the  form 


(2.11) 


where  H ^ • 


i is  an  m x m full  rank  matrix  at  each  "i".  Then  using  the 
linear  transformation 


3i  = 


I 

m 

1 Ht(2) 

0 

I 

n-m 

*i 


Dellon  obtained  an  equivalent  state  space  where  the 
in  the  form 


vh(,,i  °] 


measurement  matrix  was 


(2.13) 


Without  loss  of  generality  the  system  (2.1),  (2.2)  was  assumed  to  be  already 
in  this  desired  form  and  the  observer  matrix  T£  was  taken  to  be 

V [kJi] 


(2.14) 


where  Kj  is  a free  (n-m)  x m gain  matrix.  From  (2.9)  it  is  shown  that  the 
observer  matrix  is  of  the  form 


Fi  = A22  + Ki+1A121 


(2.15) 


where  A 22‘  and  A^1  are  respectively  (n-m)  x (n-m)  and  m x (n-m) 
partitions  of  the  matrix  Aj  in  (2.1).  Invoking  the  dual  of  Wonham's  result 
for  controllability,  [33]  Dellon  argued  that  if  (A^1,  A^1)  is  an  observable 
pair  then  there  exists  a matrix  K[+1  such  that  the  eigenvalues  of 
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A22  +Ki+lAi2l  may  **  arWcrarlly  ‘ssipied.  801  (A22iA12*  18  “ 

observable  pair  at  every  ”1"  provided  the  system  Is  completely  uniformly 
observable.  Thus,  the  eigenvalues  of  Fj  are  completely  arbitrary  at  each 
instant ’T*. 

Returning  to  the  Idea  of  state  reconstruction,  we  note  that  since  the 

entire  state  x^  Is  not  directly  accessible  It  is  unlikely  that  the  condition 

z =Tx  can  be  achieved.  This  implies  that  the  observer  error  (2.5)  will 
— O 0-0 

in  general  be  non  zero  and  the  estimate  Xj  in  (2.6)  will  be  in  error.  However, 
since  the  observer  eigenvalues  were  shown  to  be  completely  arbitrary,  It  is 
therefore  possible  to  reduce  the  observer  error  to  zero  as  rapidly  as 
desired.  Thus,  we  have  forced  the  estimate  Xj  to  approach  the  true  state  Xj 
as  rapidly  as  desired. 

2.2  OBSERVERS  OF  ORDER  "n" 

Williams  [31]  has  considered  non- minimal  order  observers  and  has 
approached  the  observer  design  problem  with  the  idea  of  achieving  suboptimal 
Kalman  filtering.  Consider  the  n-dimenslonal  observer  given  as 

*i+l  = + Gi“i  + Di+l*i+i  (2‘ 16) 


Here  the  observer  output  is  defined  by  the  relation 


Williams  has  shown  that  the  system  (2.16)  la  an  observer  of  the  state  ^ in 
(2.1)  If  and  only  If  the  following  matrix  relations  are  satisfied 


r 


Ti+iAi  * FiTi + Dt+iHi+iAi 


(2.19) 

(2.20) 


The  corresponding  estimation  error  is  given  by  the  expression 

~i*Tl  1 Fj)  <5o  • To5o>  (2.21) 


One  obtains  an  interesting  solution  to  (2.19)  by  taking 


Di+1  = Ti+lKl+l 

(2.22) 

where  Kl+J  is  an  arbitrary  n x m gain  matrix 

observer  equations  become 

• With  this  choice  for  the 

FIT1  * Ti««  • Kl+lH1+l>  ^ 

(2.23) 

Gl  * TI+1G  ’ Ki+lHi+l)  Bl 

(2.24) 

An  interesting  observation  concerning  (2.23),  (2.24)  is  that  die  special  case 
where  Tj  a I and  Kj  is  taken  to  be  the  Kalman  filter  gain  matrix,  the  observer 
obtained  is  identical  to  the  Kalman  filter.  That  is,  the  observer  equations 
become 

P,  = 0 - Kl+1H1+1)  A, 

(2.25) 

°1  ■ 0 - Kl+1H,+1)  8, 

(2.26) 

Dl+1  “ Ki+1 

(2.27) 

W ' — — ' ^ 

- ■ — — - - - rm-T~- ,jT,i—  mmm ir— mm i— — — 

| 

Substituting  (2.25),  (2.26)  and  (2.27)  Into  the  observer  system  equation  (2.16) 
gives  the  result 

^i+l  * A&  + B|Ht  + Ki+i  Ui+l  ‘ Hi+1  tA[£i  +BtMi>)  (2.28) 

which  clearly  shows  the  observer  to  he  identical  to  the  Kalman  filter.  If  the 
designer  picks  the  gain  matrix  K . +1  according  to  some  other  criterion,  the 
observer  then  may  be  viewed  as  a suboptlmal  Kalman  filter.  (For  example, 
the  gain  matrix  might  be  chosen  to  give  some  arbitrary  set  of  eigenvalues.) 

Therefore,  a Kalman  filter  is  an  n-dimensional  observer  for  which  the 
weighting  matrix  D.+j  has  been  chosen  to  minimize  the  mean  square 
estimation  error.  It  is  also  interesting  to  note  that  in  the  more  general  case 
where  the  transformation  Tj  Is  a k x n rectangular  matrix  (k  < n),  the 
solution  of  the  fundamental  observer  equation  (2.23)  is  an  aggregation  in 
tite  sense  of  Aoki . [ 2 ] We  shall  not  pursue  this  idea  any  further  since  our 
interest  in  this  observer  formulation  will  be  primarily  the  design  of  n- 
dimcnsional  observers  based  on  the  selection  of  eigenvalues. 

By  a judicious  choice  for  the  observer  transformation  T^,  Williams 
has  shown  that  it  is  possible  to  obtain  completely  arbitrary  eigenvalues  at 
each  instant  "i"  for  an  observer  of  the  form  (2.16).  He  considered  a 
completely  uniformly  observable  pair  (Aj,  h^)  and  took  as  the  transformation 
Tj  the  following  matrix  product 
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T,* 


1*1 


0 

1 


l-l 


*.  1 


A 


l-l 


l-l 


A 


i-i 


-i+1 

n 

J*o 

Ai+j 

1 

-l+l 

• 

n 

j-0 

• 

• 

Ai+j 

• 

• 

n-l 

-l+l 

n 

j-0 

Ai+j 

(2.29) 


Observability  Matrix 

where  for  the  purpose  of  simplicity  we  have  considered  a single  output  system. 
The  results  are  easily  extended  to  the  multiple  output  case.  For  the 
particular  transformation  Tj  chosen  the  observer  system  matrix  is  in 
column  companion  form  and  has  arbitrary  eigenvalues. 


1 

0 


0 

1 


Y 0 0 0 


Ti+lAiTi 


[10  0 ...  0] 


(2.30) 


T>+lKi+l 


-1+1  Ai  Tt 


-1 


Since  the  gain  matrix  Ki+J  is  completely  arbitrary  and  the  matrix  TJ+1  is 
nonsingular,  from  (2.30)  it  is  apparent  that  any  desired  set  of  observer 
eigenvalues  may  be  obtained. 

2 . 3 APPLICATION  TO  OPTIMAL  CONTROL 

One  of  the  fundamental  applications  of  observer  theory  is  in  the 
design  of  feedback  controllers  for  the  linear  regulator  problem  where  some 
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of  the  states  are  inaccessible  and  must  therefore  be  estimated  using  an 
observer.  For  example,  assume  it  is  required  to  obtain  the  control  ut  in 
(2.1)  which  minimizes  the  cost  function 

J = L 'Qiij  + “i  'Ri“i  <2  -31> 

where  and  Rj  are  respectively  n x n and  p x p symmetric  positive  definite 
matrices  for  all  "i"  in  the  interval  [0,N].  The  feedback  law  which  minimizes 
J is  known  to  be  a linear  state  feedback  of  the  form  [30 ] 

Uj  = / jXj  (2.32) 


where 


(R1  + BlTi+1B1) 


-1 


“iVA 


(2.33) 


and  r.  is  the  n x n symmetric  positive  definite  solution  to  the  discrete 
Ricatti  equation 


i = Ai  - i+i 


A,  - VWl  <*i  +Bi'ri+lBi>'1  BiVl  +QI 


with 


‘N 


(2.34) 


Applying  the  optimal  feedback  control  results  in  the  minimal  cost 


0*0 


(2.35) 


By  assumption  the  entire  state  vector  Xj  is  not  directly  available  for  measure- 
ment and  therefore  the  optimal  feedback  control  can  not  be  implemented. 

The  alternative  considered  here  is  to  use  a minimal-order  observer  to 
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construct  an  estimate  ^ of  the  state  x4  and  apply  the  suboptlmal  feedback 


control 


H|  “ ' A 


(2.36) 


It  is  of  interest  to  determine  the  effect  of  the  observer  upon  the  control  law. 
Substitution  (2.6)  into  (2.36)  and  using  the  fact  that  PjTj  + VjHj  « ^ it  is 
easily  verified  that  the  subuptimal  control  law  is  given  by  the  expression 


Hi  W>A*A 


(2.37) 


It  is  clear  from  (2.37)  that  Uj  is  the  sum  of  the  optimal  control  plus  an 
additive  term  due  to  the  incorrect  observer  initial  condition.  The  obvious 
conclusion  is  that  introducing  an  observer  in  the  loop  generally  results  in  an 
increase  in  cost  from  that  obtained  when  the  optimal  control  law  is 
implemented.  Further,  this  Increase  in  cost  has  been  shown  by  DeUon  [lO] 


to  lx:  of  the  form 


J a J • -»-  « C 
J J — O 0-0 


(2.38) 


where  the  positive  definite  matrix  ^ satisfies  the  recursive  equation 

V1  * F/*H-lFi  +P1#V<ri  +Bi#AHdBl)AiPi 


(2.39) 


To  determine  the  effect  of  an  observer  on  the  stability  properties  of  a closed 
loop  control  system  in  which  It  is  used  we  assume  it  is  desired  to  control 
the  linear  system  (2.1)  by  the  linear  feedback  law 


Presumably  will  be  chosen  by  the  designer  such  that  the  closed  loop  system, 
defined  by 

-i+1  = ^Ai  +BiKt>5j 

(2.41) 

li  s Hi*i 

achieves  some  desirable  response  properties,  which  will  always  include 
stability.  However,  the  actual  state  vector  Xj  is  not  directly  available  and  a 
discrete  time-varying  minimal-order  observer  Is  used  to  generate  an 

estimate  Xj  of  the  state  x^.  The  estimate  Xj  is  seen  from  (2.6)  to  be  of  the 
form 

-i  = PA  + VA  (2.42) 

where  2j  is  the  output  of  the  minimal-order  observer  and  ^ is  the  plant 

output  vector.  Applying  the  control  law  (2.40)  with  the  state  estimate  x. 

— i 

(2.42)  gives  the  closed-loop  state  equation 

-1+1  * <At  +BtKlVlHl>il  + BlKiPlil  (2.43) 

Also  applying  the  same  input  to  the  observer  gives 

^i+1  = Ti+l<Ai  + BiK  i^iii  + Ti+1(Aj  + BjK  j)  V.HjXj  (2 . 44) 

Combining  (2.43)  and  (2.44)  results  in  the  following  state  equation 


ii+r 

at 

Ai  4-BjKjVjH^  j BjKjP, 

-i 

-i+i . 

T1+I(A,+B1K1)V1H1  | T^A, +B|K,)Pt 

A . 

(2.45) 


The  stability  properties  of  the  overall  closed-loop  system  become  apparent 
when  the  system  is  viewed  in  a different  state  space.  With  this  thought  in 
mind,  we  perform  the  coordinate  transformation  i5l 


r i 

0 • 

n 

.'Ti 

I 

n-m . 

(2.46) 


This  nonsingular  transformation  results  in  the  equivalent  state  space 
representation 


-i+1 

‘ Ai+¥i 

-Wi  ■ 

' V 

.-i+1  . 

0 

Fi  . 

.ii. 

In  the  special  case  of  time-invariant  systems  It  is  clear  that  the  eigenvalues 
of  the  overall  system  are  the  eigenvalues  of  A + BK  plus  the  eigenvalues  of  the 
observer  system,  F.  By  assumption  the  closed-loop  system  A +BK  has 
stable  eigenvalues  and  since  the  observer  is  designed  tc  have  stable  eigen- 
values then  the  overall  system  is  obviously  stable . Hence  in  the  time 
invariant  situation  it  is  clear  that  the  observer  does  not  affect  the  optimal 
closed-loop  poles  at  all,  it  merely  adds  some  poles  of  its  own  [20  ]. 

Intuitively  one  would  expect  this  same  result  to  carry  over  to  the  more 
general  time -varying  case.  However,  although  it  is  true  that  at  any  fixed 
instant  "i"  the  eigenvalues  of  the  system  matrix  (2.47)  are  the  eigenvalues  of 
Aj  plus  the  eigenvalues  of  F-,  this  does  not  imply  stability  of  the  overall 

system  (2.47)  in  any  rigorous  fashion.  To  prove  stability  in  the  more 
general  case  a more  careful  consideration  of  the  state  equations  must  be 
taken. 


It  Is,  of  course,  assumed  that  the  designer  has  constructed  a stable 
time -varying  observer.  Hence  the  observer-error  is  bounded  and  to  prove 
boundedness  of  the  closed-loop  state  vector  (2.47)  it  is  sufficient  to  prove 


boundedness  of  the  subvector  Xj.  From  (2.47)  we  have 


xl+l  = <Ai+B|K(>xl-BlK|Pi£, 


(2.48) 


which  has  the  solution 


x - 1)  x S ' ra  B K P £■ 
-«  i.o*o  i.j+1  JJH 


(2.49) 


where 


^o-To*o> 


and  the  transition  matrix  rx  . is  defined  as 

M J 


7,,=  n (Ak+BRKk) 
I,J  k=j 

Taking  the  norm  of  (2.49) 


-i  ' V + ? \ i+i  IB)KIPJ  •Fj.o'  i, 


(2.5U) 


(2.51) 


(2.52) 


Since  by  assumption  Q and  F.  Q are  uniformly  asymptotically  stable  we 
have  .10] 


9,  s c , gl,  for  some  c . > 0 and  0 < 8 . <1 

i,o  1 1 1 1 


F.  s co0o  for  some  c0  > 0 and  0 < 8.,  < 1 
t,  o 2 l i i 


(2.53) 


(2.54) 


Let  jPj •'  5 Cj  < ® and  (2.52)  becomes 


i-1 


-i ” " +C1C2C3  2 ®i  ■*  ^2 

}=<> 

Evaluating  the  sum  in  (2.55)  gives 


— o 


(2.55) 


/gi  . v 

I'— ii'  -ciei  +cic2c3  \ W~- 


lie. 


(2.56) 


Thus  ,'x^'is  bounded  for  all  "l"  and  since  lim  j'xj!.'  -0  for  all  finite  then  the 
closeddoop  system  (2.45)  is  uniformly  asymptotically  stable. 


2.4  ADDITIONAL  COMMENTS 

It  should  be  emphasized  at  this  time  that  the  design  procedures  of 
Huddle,  Dellon  and  Williams  involve  little  more  than  the  statement  that  the 
designer  is  free  to  choose  the  observer  eigenvalues  in  any  desired  fashion. 
The  fundamentally  important  problem  of  where  to  place  the  observer  eigen- 
values has  not  yet  been  solved  and  remains  a perplexing  problem  to  the 
designer.  It  is,  of  course,  useful  to  know  that  one  may  design  (n-m)- 
dimensional  observers  or  n-dlmensional  observers  with  arbitrary  eigenvalues 
at  each  instant  "i";  however,  without  the  added  information  of  where  to 
optimally  place  the  eigenvalues,  the  design  of  the  observer  remains  at  best  an 
ad  hoc  procedure. 

In  contrast  to  the  idea  of  artifically  picking  the  observer  eigenvalues 
to  provide  acceptable  system  performance,  we  shall  base  our  observer 
design  on  the  more  fundamental  objective  of  minimizing  the  effects  of  system 
noise  disturbances  upon  the  observer  derived  estimate  fcj.  In  formulating  the 
observer  design  problem  in  a more  general  stochastic  setting,  the  resultant 


observer  errors  will  be  dependent  upon  the  plant  noise  disturbances  and  from 
a consideration  of  the  noise  Induced  errors  an  optimal  observer  design  will  be 
obtained.  We  shall  obtain  a solution  for  the  observer  matrices  Fj.T.  and  L>t 
which  not  only  satisfies  the  fundamental  observer  equation  Tl+1A.  = 

FjTj  + DjHj,  but  results  in  an  observer  system  which  is  also  optimal  in  the 
mean'square  sense. 
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SECTION  III 

OBSERVERS  FOR  DISCRETE  TIME-VARYING  SYSTEMS  WITH 
WHITE  NOISE  INPUTS 

3.1  INTRODUCTION 

In  this  chapter  we  shall  focus  our  attention  upon  Linear,  discrete-time 
stochastic  systems  for  which  the  dynamic  behavior  can  be  characterized  by 
the  following  set  of  equations . 


ii+l  = Ai*i+BiHi  + wl  (3.1) 

*i  = H&+li  (3.2) 

where  Xj  is  the  n-dlmensional  state  of  the  system  at  time  "l”,  Uj  is  the  p- 
dimensional  known  control  vector  which  acts  upon  the  system  at  time  "i",  and 
is  the  m-dimenslonal  measurement  vector.  The  initial  state  is  a 
Gaussian  random  vector  with  known  mean  and  covariance 

El<S0-«0Hi0-x0)'J  = Mo 

Further,  the  noise  sequences  Wj  and  vt  are  assumed  to  be  Gaussian  random 
vectors  with  known  means  and  covariances 

Etwjj-O  for  all  "i" 

E Uj } =0  for  all  ”1" 


r 


Blw,y/V}  * Qi6tj 

-Ri\j 


where  6^  is  the  Kronecker  delta.  In  general,  the  covariance  IV  will  he  con- 
sidered to  be  positive  definite  whereas  the  covariance  will  be  positive 
semi-definite.  The  various  random  vectors  are  also  assumed  to  lx*  mutually 
uncorrelated  so  we  have  the  relations 


E Ixw.  '}  = 0 
— 0“1 

for  all  "i" 

E lx  v. '}  =0 
-o-i 

for  all  "i" 

E lw.  v . ' } = 0 

for  all  "l,. 

Thus  it  is  assumed  in  this  chapter  that  the  noise  sequences  w^  and  v.  are  time- 
wise  uncorrelated  sequences  which  shall  be  referred  to  as  Gaussian  white 
sequences.  In  the  interest  of  simplicity,  at  this  point  we  have  assumed  a 
model  for  the  white  noise  sequences  in  which  the  cross -covariance  matrix  of 
w^  and  Vj  is  zero.  Later  in  this  chapter  we  shall  extend  our  results  to  include 
the  special  case  whereby  w.  and  v(  are  Gaussian  white  sequences  which  arc 
crosscor related  at  time  "1."  Also,  in  the  next  chapter  we  shall  consider  the 
more  general  situation  in  which  the  noise  sequences  w^  and  are  time-wise 
correlated  sequences  of  the  Gauss -Markov  type. 


3.2  DEFINITION  OF  THE  DISCRETE  OBSERVER  FOR  STOCHASTIC 
SYSTEMS 

Loosely  speaking,  for  stochastic  systems  an  observer  is  defined  to  lx* 
a system  whose  output  vector,  Zj+1,  is  an  estimate  of  the  quantity  T^x+i 
with  an  estimation  error,  , depending  only  on  the  previous  estimation 
error,  jjj , and  the  plant  and  measurement  noises  w.,v(.  To  be  more  precise 


I 
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iho  discrete  time-varying  system 


ii+lmFft+CiHi+Di*i 

is  called  an  observer  of  the  state  Xj  of  the  system 
-i+1  * AA  + Bi-i  + -1 
*t  = HA  + *1 


(3.6) 


(3.7) 

(3.8) 


if  at  each  instant  "i"  the  following  relation  holds 


i,  - Tl*i  +I| 


(3.9) 


where  the  observer  estimation  error,  £j,  evolves  according  to  the  recursive 
equation 


-i+1  = Fi-l  + Di-i  ‘ Tt+l-l 


(3.10) 


In  order  that  the  above  relations  hold,  it  is  both  necessary  and  sufficient 
that  the  following  matrix  equations  be  satisfied  at  each  instant  "i" 


Ti+lAi  = FiTi  + DiHi 


Gi  = Ti+lBi 


(3.11) 

(3.12) 


Necessity  is  proved  as  follows.  Assuming  (3.6)  and  (3.9)  to  hold,  one  obtains 
the  result 


^i+l*!  ‘ FiTi  ' DiHi^  — i + ^i+l8!  * Gl^i 


+ -l+l  ‘ Fl-i  ‘ D£l  + Tl+l-l  = ^ 


(3.13) 


Since  (3.13)  must  be  satisfied  for  all  state  vectors  x(  and  for  all  control 
vectors  u^,  take  x^  ■ 0 and  u^  > 0.  This  implies  the  following  result. 
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(3.14) 


-l+l  " F A + D£i  ‘ Ti+l-l 


Hence,  (3.13)  reduces  to  the  following 

CWi ' FiTi ' +<Tt+iBi  ’ Gt>H,  -2 


(3.15) 


But  (3.15)  must  hold  for  all  state  vectors  and  for  all  control  vectors  Uj,  so 
take  Uj  * 0 and  x^  arbitrary.  This  Implies  the  following  result. 


Ti«VFiTi  + DiHi 


(3.16) 


Also  in  (3.15)  we  may  take  Xj  = 0 and  u^  arbitrary.  This  Implies  the  following 
result. 


°i * Ti+iBi 


(3.17) 


Conversely,  assume  equations  (3.11),  (3.12)  to  be  satisfied  at  each  instant 
"l".  Then  from  (3.6),  (3.7)  and  (3.8)  we  obtain  the  following. 


*1+1  - Ti+Iii+1  * fA+gA  + di<hA  +it> 

-T1+i<AA+Bft  + *.> 


(3.18) 


Substituting  (3.12)  into  (3.18)  gives  the  following  result. 

ii+1  ‘ Ti+l-i+l  * F&  + (°lHi  ' Tt+lApil  +DA  * Ti+l-i  *3,1^ 
Next,  since  = -(DjHj  - Tl+1A,)  from  (3.11),  we  obtain  the  result 

2|+1  ‘ Tl+l-i+l  x Fi^l  ’ T£l>  + D£l  ‘ Tl+l-i  (3,a0) 


Clearly,  (3.20)  Implies  the  following  relations 


*1  * Tt5i  +£i 


(3.21) 
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£,+,  - Fjt,  + D,*,  • T,+1w, 


(3.22) 


From  (3.22)  It  is  seen  that  the  observer  error  at  time  "i+l"  depends 
only  upon  the  previous  observer  error  ^ at  time  "l"  and  also  on  the  noise 
disturbances  , v ^ . 


AN  OPTIMAL  MINIMAL-ORDER  OBSERVER  DESIGN 


The  discrete  time-varying  system  described  by  the  equations 


z^i-FjZi+CiUt+Dtii 


(3.23) 


*i  * Tj*t  +£t 


(3.24) 


where  an  (n-m) -dimensional  vector,  is  called  a minimal-order  observer 
of  the  state  Xj  of  the  system  (3.1),  (3.2)  if  at  each  Instant  "l"  the  following 


matrix  relations  are  satisfied 


Tl+lAi  * FlTi  + DiHi 


(3.25) 


Gl  * Ti+lBl 


(3.26) 


RJ 


exists 


(3.27) 


Equation  (3.25)  is  the  fundamental  observer  equation  relating  the  observer 


system  matrices  F^  and  D^  to  the  observer  transformation  matrix  Tj.  In 
the  design  of  a minimal-order  observer  the  additional  constraint  (3.27)  must 


also  be  satisfied  at  each  instant  "i".  Using  this  fact,  a general  solution  to 


the  observer  equation  (3.25)  may  be  obtained.  Rewriting  (3.25)  in 


partitioned  form 
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Tl+1A 


1*  |Fi,Di|  [hJ“] 


(3.28) 


and  postulating  the  existence  of  the  matrix  Inverse  to  be  of  the  form 


rr. 


rl'-l 


p,Iv, 


(3.29) 


where  is  an  n x (n-m)  matrix  and  V.  is  an  n x m matrix,  one  obtains  upon 
multiplying  (3.28)  from  the  right  by  the  above  Inverse,  the  solution 


Fl  * Ti+lAlPl 


(3.30) 


U»  " VlVl 


(3.31) 


From  (3.30),  (3.31)  It  Is  seen  that  the  design  of  the  minlmaborder  observer 
has  hecn  reduced  to  the  selection  of  the  single  matrix  T. . This  Is  seen  from 
(3.29).  Specification  of  the  matrix  Tj,  together  with  the  known  measurement 
matrix  Hj  uniquely  defines  the  matrices  P(  and  and  from  equations  (3.30) 
and  (3.31)  Is  seen  to  uniquely  tie  fine  the  observer  system  matrices  Fj  and  D . 

The  observer  error,  c^,  was  shown  previously  to  satisfy  the  following 
difference  equation. 


-l+l  " FA  + °£l  * Tl+l-l 


(3.32) 


Using  the  solution  (3.30),  (3.31)  together  with  the  error  difference  equation 
(3.32)  one  obtains  the  observer  error  covariance  given  as  (3.33). 


ii+A+. ' ■ ti+i <Yivr«vv +wiW +<v ti«'  <3-“> 


We  shall  define  the  matrix  fij  to  be  the  following. 
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V ViiiVv  V + WiVV*^ 

h will  Ik*  useful  at  ihis  point  to  partition  (3.33)  as  follows. 


(3.34) 


*t+1^4+l ' * Ti+! 


K, 

n 

12 

"21 

^2 

T ' 
i+1 


(3.35) 


where  f<‘n  Is  m x m.  is  (n-m)  x (n-m)  and  .^'ismx  (n-m).  The 
submatrices  f^2  and  are  obtained  as  partitions  of  the  matrix 
defined  by  (3.34). 

Equation  (3.35)  plays  a fundamental  role  in  the  optimal  observer 
design  to  be  developed.  We  shall  next  obtain  the  covariance  matrix  of  the 
overall  estimation  error.  The  estimate  x,+1  of  the  state  vector  x^j  is 
obtained  as  follows.  (The  notation  x|+J  shall  be  used  to  distinguish  between 
the  optimal  Kalman  filter  estimate  and  the  observer  derived  estimate.) 
Combining  the  observer  output  *t+J  with  the  measurement^  gives  the 
following. 


(3.3ty 


Using  the  matrix  inverse  postulated  as  equation  (3.29X  we  obtain  the  estimate 

ii+r 


r-i+r 

Ti+r 

r« 

-1+1 

U+i. 

Hi+i. 

it+l  + 

.-i+i . 

ii+1  * + I V,+J 


-i+1 


L -i+1  J 


(3.37) 


The  resulting  estimation  error  is  found  to  be 
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(3.38) 


'-1+1  ^ -l+l  ' — i+1  = |Pi+l  ^ Vi+1 


^i+1 


L-i+1 


Finally,  the  error  covariance  e^e^'  may  be  obtained  as  follows. 


-i+1— i+1  = I Pi+1  ^ Vi+l) 

(3.39) 

where  from  (3.32)  it  may  be  shown  that  1 = 0. 

To  proceed  further,  some  necessary  assumptions  must  be  made  about 
the  form  of  system  (3.1),  (3.2).  It  is,  of  course,  assumed  that  the  measure- 
ment matrix  be  of  maximal  rank  at  each  instant  "l"  in  the  interval  of  interest. 
In  the  absence  of  measurement  noise.  If  Hj  did  not  exhibit  this  characteristic, 
then  some  of  the  measurements  would  be  linearly  dependent  and,  hence, 
redundant,  so  that  the  measurement  vector  could  be  reduced  to  a linearly 
independent  set  without  any  loss  of  information.  In  cases  where  the  system 
outputs  are  corrupted  by  measurement  noise,  there  may  however  be  important 
reasons  to  consider  all  the  system  outputs,  including  any  redundant  ones. 

We  shall  not,  however,  treat  this  case  but  shall  consider  only  matrices  Hi  of 
full  rank. 

More  specifically.  It  is  assumed  that  the  first  "m"  columns  of  H.  (with 
a possible  renumbering  of  the  states)  are  linearly  independent  for  all  ”i"  in 
the  interval  of  interest.  This  is  a reasonable  assumption  in  view  of  the  fact 
that  usually  the  system  outputs  are  affected  by  the  same  state  variables  even 
though  the  gains  involved  may  vary  with  time.  In  many  physical  systems  Hj 
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will  actually  be  a constant  matrix  even  though  the  matrices  B,  are  tlme- 
varying.  Therefore  Hj  may  be  partitioned  as  follows. 


where  i^is  nonslnguUr  at  each  Instant  T in  the  Interval  of  interest.  Next 
we  shall  assume  that  H is  Identically  zero  since  the  linear  transformation 


*i 


'h}0'* 

0 

I 

m 

n-m 

(3.41) 


will  transform  the  original  system  to  the  desired  form  shown  in  equation 
(3.42).  Therefore,  without  loss  of  generality,  it  will  be  assumed  that  the 
measurements  are  of  the  form 

*1  * [lm  1 0 +*i  <3.42) 


To  complete  the  basic  observer  design,  it  remains  only  to  specify  the 

[t.  i-i 

ft-  must  exist  at  each  instant 

i , me  most  logical  choice  for  the  matrix  Tj  Is  given  below  as  (3.43). 

T,  * [K.  | 1 ] ,, 

i l n-m  (3.4> 

Kl  is  an  arbitrary  (n-m)  x m gain  matrix  which  will  be  chosen  to  minimize 
the  overall  estimation  error.  With  this  choice  for  the  matrix  Tj,  the 
matrices  Pt  and  Vj  are  found  to  be  the  following 


(3.44) 
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Substituting  (3.44)  into  (3.39)  gives  the  following  result. 


Also,  substituting  (3.43)  into  (3.35)  gives  the  result 

-i+1^1+1  = Ki+inilKi+l  +Ki+iri12  + fi21Ki+l  +f^2  (3.46) 

The  optimal  gain  matrix  may  now  be  determined.  From  (3.45)  and 

(3.46)  one  obtains 


trace  6^/  = trace  Rw 

(3.47) 

+ trace  {K i+i^n  + Ri+P Ki+l  + Ki+lfll2  + fi21Ki+l ' + n22^ 
"Completing  the  square"  in  (3.47)  gives  the  result 

trace  ei+ie.+1 ' - trace  Rl+i 
+ trace  { [K  i+1  + ^(^  Y + Ri+J)  3 CnA  x + Ri+1 1 [K  l+1  + 

(3.48) 

+ n21^1 1 + Rl+P  ^ + n22‘n2l^°l  l+  Ri+P  1 ^12  ^ 


The  desired  optimal  gain  matrix,  Ki+1*,  is  obtained  by  minimizing  the 
trace  ej^Jej^J ' . By  assumption  the  measurement  noise  covariance  R^+1  is 
positive  definite.  Clearly,  the  submatrix  is  at  least  positive  semi- 
definite  so  that  the  matrices  (D^  +Ri+p  ant*  (^ii  +Ri+P  * are  P°sl^ve 
definite.  Therefore  the  matrices 


fKl+l  +fi21<fill  + Rt+1>  1]Cnil  +Ri+1HKl+i+^i(^i  + R1+1)‘1]' 


'421<^11  +Ri+1>  ^12 

must  have  positive  diagonal  elements.  The  minimum  of  the  diagonal 
elements  of  ei+1eJ+1 ' must  therefore  be  attained  when 

K i+1  + f 21  ^11  + Ri+P  1 * 0 

Clearly  the  optimal  gain  matrix  K*+J  is  given  by  the  expression 
Ki+1*  = ‘^l^ll  +Ri+P 


(3.49) 


(3.50) 


(3.51) 


(3.52) 


The  minimal  estimation  error  obtained  when  K(+1*  is  taken  to  be  the  observer 
gain  matrix  is  found  by  substituting  equation  (2.39)  into  equation  (2.35).  Thus 
it  is  found  that 

min  trace  ei+1el+/  « trace  Retrace  - ^(^R^)' 1 

(3.53) 

Design  of  the  optimal  minimal*order  observer  is  essentially  complete  at  this 
point;  it  remains  only  to  specify  the  resulting  observer  dynamical  structure. 

Previously  it  was  shown  that  the  observer  matrices  were  of  the  form 
Fi  = Th-iAiPi  and  Di  = Ti+iAiVi*  Straightforward  substitution  of  the  observer 
transformation  matrix  T^  [equation  (3.43)]  and  the  corresponding  matrices 
Pj  and  Vj  i. equation  (3.44)]  results  in  the  following 


31 


(3.54) 


Fi  = A22  + Ki+1A12 

Di  = A21  ' A22Ki  + Ki+1*A11  ‘ Al2Ki^  (3.55) 

Also,  l he  matrix  Gj  is  defined  explicitly  in  terms  of  the  observer  transfor- 
mation T.+1  and  the  plant  matrix  Bj  according  to  the  relation 

Gi  = Ti-flBi  (3.56) 

A block  diagram  of  the  basic  observer  structure  is  shown  in  Figure  3.1  along 
with  the  appropriate  defining  equations  and  the  algorithm  for  obtaining  the 
optimal  observer  gain  matrix. 

3.4  INITIALIZATION  OF  THE  DISCRETE  OBSERVER 

In  the  case  of  the  recursive  Kalman  filter  equations,  the  a priori 
statistics  and  MQ  of  the  initial  state  ^ are  assumed  to  be  known.  This 
a priori  information  is  needed  to  initialize  the  Kalman  filter.  Since  the 
optimal  observer  equations  (3.35)  and  (3.52)  are  also  recursive,  this  same 
information  is  needed  to  initialize  the  observer.  We  shall  therefore  assume 
that  the  a priori  statistics  x^  and  Mq  are  available  to  the  observer  system. 

Initialization  of  the  observer  proceeds  as  follows . Let  Zj  = TjX^  be 
the  observer  initial  condition,  where  Xj  is  the  "expected  value"  of  the  state 
vector  Xj . Since  - TJx1 , then 

£A,-Ti<si‘ii>ferSi>'Ti'  <3-57> 

"“•irii-Aotvv+s.  hence  (3.57)  becomes 

iA'-WoV  + VV  (3.58) 

To  initialize  the  observer,  define  the  covariance  matrix  fi  to  be 

o 

f‘o*  AoMoAo/+Qo  (3.59) 
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Figure  3.1  Optimal  Minimal-Order  Observer  Structure 


and  take  the  optimal  gain  matrix  K ^ * to  be 
Kl*  * '^1^1  +R1*  1 


(3.60) 


3.5  SPECIAL  CASE:  CROSS  CORRELATED  PLANT  AND  MEASUREMENT 

NOISES 

In  the  interest  of  simplicity  we  have  assumed  that  the  original  model  of 
the  Gaussian  white  noise  sequences  is  one  in  which  the  cross -covariance 
matrix  of  Wj  and  v^  is  zero.  We  shall  now  treat  this  important  special  case  in 
which  the  cross -covariance  matrix  of  Wj  and  Vj  is  non-zero  and  we  shall  show 
that  the  observer  design  technique  described  in  the  previous  sections  of  this 
chapter  is  directly  applicable  to  this  special  case  with  only  minor  modifications 
to  the  theory.  At  this  point  we  shall  assume  that  the  zero-mean  Gaussian  white 
sequences  w(  and  v^  are  characterized  by  the  covariance  relations : 

B IwjWj  ' } « 

-R,4y 

. S,«u 

We  begin  by  computing  the  observer-error  covariance  matrix.  From  the 
basic  observer-error  equation  (3.10)  we  obtain  the  result 


fi+lii+1  * = F^iii # F1  * + ' Di ' Ti+l-i-i  * Ti+i  ’ 


(3.61) 


‘ Di^-l  * Tl+1  * Ti+l-^t  ’ Di 


# n f 


But  since  Fj  » T^jAjP,  and  Dj  » Ti+JAfVt,  substituting  these  relations 
into  (3.61)  gives 


34 


JrA+I ' - T,+,< V,  M.  VV  + *1  Wl  'A, ' + <y  Tl+1 ' 

Tl+i(JSVlS*  + Sl  \ '>  Tl+1 ' (3.M) 

Hence,  the  same  general  form  of  solution  is  obtained  as  in  the  previous 
uncrosscorrelated  noise  case.  Defining  the  matrix  to  be 


^V^VV  + WiVV+Qi 


(3.63) 


-ViVWV 


and  partitioning  (3.63)  as  before  we  obtain  the  result 


^4+l^i+l * * Tl+1 


"i.  | ^ 

°22 


T ' 
*1+1 


(3.64) 


It  is  immediately  obvious  that  the  observer  design  developed  previously  in 
this  chapter  applies  without  modification  from  this  point  on.  For  the  sake  of 
brevity  we  shall  state  only  the  final  results.  Taking  the  observer  trans- 
formation matrix  to  be  of  the  form 


tKu.|ll ] 


l+l  l+l  1 n-m 


(3.65) 


The  optimal  gain  matrix  K^j*  is  found  to  be 
Kl+1*  “ ‘^21^11  + Ri+P 


(3.66) 


where  the  matrices  f<jj  and  are  obtained  from  the  partitioned  matrix 
as  Indicated  in  (3.64).  The  cross -covariance  matrix,  Sj,  alters  only  the 
computation  of  the  f<j  matrix  as  indicated  in  (3.63). 


3.6  liM-BCT  OF  COORDINATE  TRANSFORMATION  ON  OPTIMAL  GAIN 
MATRIX,  K4* 

Up  to  this  point  It  has  boon  tacitly  assumed  that  "without  loss  of 
generality”  the  given  system  (3.1),  (3.2}  was  already  in  the  desired  canonical 
form.  However,  the  phrase  "without  loss  of  generality"  needs  to  be  justified 
since  for  many  dynamical  systems  the  desired  canonical  form  cannot  be 
obtained  directly  by  merely  renumbering  the  state  variables.  We  do,  however, 
assume  that  the  system  measurement  matrix,  Hj,  can  be  put  into  the  form 
(3.40)  and  then  the  linear  transformation  (3.41)  applied  to  obtain  the  desired 
canonical  equations.  If  this  transformation  need  be  used,  then  there  will 
be  a modification  to  the  optimal  gain  matrix,  Kj+i*,  due  to  the  linear  trans- 
formation (3.41).  We  shall  now  consider  the  effect  of  this  linear  trans- 
formation upon  our  optimization  technique  and,  in  particular,  we  shall  derive 
the  optimal  gain  matrix  taking  Into  account  the  effect  of  the  linear 
transformation  (3.41). 

Assume  It  is  necessary  to  apply  the  linear  transformation  x^  = M^, 
where  Mj  is  defined  in  (3.41).  Upon  performing  this  transformation  we  have 
the  measurements 

*1  * Clm  1 0 ]Sl  + *i  <3*67> 

Let  the  observer  be  defined  by  the  system  (3.6)  where  now  we  take  the 
observer  output  to  be 

* CKj  | I ]£,  + €j  (3.68) 

Combining  (3.67)  and  (3.68)  together  with  the  fact  that  x^  = M^  we  get  the 
result 
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i 


(3.69) 


Ki 

I 

n-m 

I'm 

0 

rHi 

Hj  ' • 

0 

I 

i 

n-m 

From  (3.69)  the  overall  estimation  error  covariance  is  found  to  be  the 
following: 


hV>1  -hW'h^ 


2A  = 


Rl  -RiKl' 


•KjRj 


4-K^K^ 


(3.70) 


Equation  (3.70)  is  simply  the  statement  that  the  error  in  the  x.  coordinate 
system  is  times  the  error  in  the  coordinate  system.  That  is. 


(3.71) 


Performing  the  matrix  multiplication  indicated  in  (3.70)  and  taking  the  trace 
gives  the  result 

trace  eJeTj ' * trace  { ^ ' + K ^ ' ) 

+ trace  ||Ht(1)  cJJ/  ^H4(1)  (3.72J 

+ ^Ht(l)  1 + V^l)  Rl(Hl(1)  1 + Hll>  V^i)  | 


(3.72) 
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where  the  observer  error  covariance  is  of  the  form 

55 ' • “rfiV  **&  + "iN + 


(3.73) 


Setting  the  gradient  of  (3.72)  (with  respect  to  the  free  gain  matrix,  Kj)  equal 
to  zero  gives  the  first  order  necessary  conditions  for  a minimum.  Since 
(3.72)  is  quadratic  in  K^,  these  first  order  necessary  conditions  are  also 
sufficient  conditions  for  a minimum.  To  obtain  the  gradient  of  (3.72)  one 


But  since  the  matrices  (i  +(•)'(•  ))  and  1 + ) are  positive  definite 

(hence  invertible)  we  obtain  from  (3.75)  the  result 

Ki*  * * ^21  + t * 3)  (^j*/  +Ri)"1  (3. 7( 

where 

f * 3 ■ |l  + ( • )'(  . )J  ( • )'  Rj  (3.77 

Finally  we  note  that  for  the  special  case  where  H^2)  is  identically  zero,  the 
term  [ • ] is  identically  zero  and  the  optimal  gain  (3.76)  reduces  to  the 
result  (3.52)  obtained  previously. 


3.7  GENERALITY  OF  THE  TRANSFORMATION  T,  * [K  ll  ] 

i l n-m 

At  this  point  one  might  ask  if  the  consideration  of  a more  general 

observer  transformation,  T|P  could  result  in  a further  reduction  in  mean- 

square  estimation  error.  To  be  more  specific,  can  the  mean-square 

estimation  error  be  reduced  even  further  by  taking  Tt  = [K^|K^]  instead 

of  using  the  less  general  transformation  T.  » [K.^ll  ]?  The  answer  to 

i t n-m 

this  question  is  an  unequivocable  "no"  and  in  this  section  of  the  thesis  we 
shall  present  a proof  of  the  claim.  The  proof  is  straightforward. 

We  assume  that  the  measurements  are  already  in  the  desired 
canonical  form,  that  is: 

*i*  Clm,0]JSl+*l  (3.78) 

We  consider  the  most  general  possible  observer  transformation,  Tj  which  is 


of  the  form 


l[  - [Kj^lK^Xj  +1J 


(3.79) 


where  K ^ and  K.^  are  (n-m)  x m and  (n-m)  x (n-m)  partitions  of  the 

rHiVl 

matrix  Tj.  Since  the  matrix  inverse  )jr  is  required  to  exist  at  each 
instant  "1"  then  we  have  the  result 

det 


I 

0 

m 

K(l> 

Ki 

k<2> 

*i 

* det[K,(2)] 


(3.80) 


(1) 


and  therefore  we  consider  ail  transformations  Tj  = [K^lK^]  where 
and  K.t2)  are  arbitrary  and  is  full  rank  at  each  "l."  We  shall  now  prove 
that  at  each  step  "i"  there  is  no  loss  of  generality  by  taking  = 1^  and 
this  is  because  the  minimum  achievable  mean-square  estimation  error  is, 
in  fact,  independent  of  the  elements  of  the  partition  K 

In  the  first  step  of  the  proof  we  treat  the  initialization  of  the  observer . 
Computing  the  mean-square  estimation  error  at  time  "1=1"  we  obtain  the 
result 


trace  e^  ' * trace  Rj 


+ trace 


K <2>_1— ■ 'K 
* 1 ^1L1  K 1 


i'"1 
1 *'  1 


' + K P*  K ,^R1K  ^ 'K  f2)  1 ' 


(3.81) 


But  the  observer  error  covariance  is  T7e7'  * T.fi  T,  ' where  fi  £ A M A * 

—I—I  lot  o O O o 

+ Q0.  so  expanding  ' in  (3.81)  into  quadratic  terms  involving  the 
appropriate  partitions  of  the  matrix  nQ  gives  the  result  (3.82). 
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(3.82) 


K K ' - K K ' 

-1-1  *1  ull*l 


+ K gW* 

+ K I w12K  a 


+ kj(2)^iki(1)/ 


+ k<^2k<2>' 

Substituting  (3.82)  into  (3.81)  and  "completing  the  square"  gives  the 
expression 


trace  ' = trace  ftj 

+ tt«cej[K1<2)  **»  tR,)'1]^,  +R1][k1<2>’1k/*> 

+‘S»f?i**/1]' + ^2  - ‘Sl'j  <3-83> 

Clearly,  to  minimize  trace  e^£i ' we  la^e 


and  the  minimum  attainable  mean-square  error  is  given  by  the  result 

min  trace  trace  RA  + trace  {Cg2  - +RP'1  C^') 

(3.85) 

We  note  at  this  point  that  the  optimal  error  (3.85)  is  attained  independent 

of  the  particular  choice  of  K Hence,  the  minimum  attainable  mean- 

square  error  is  independent  of  the  partition  K ^ and  we  may  without  loss  of 

generality  take  K = I 

7 1 n-m 

For  all  cases  n=2, 3, . . .,  i,  i+1  the  solution  proceeds  as  follows.  At 
time  "i+1"  the  equations  of  interest  are  the  following: 
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*1+1  ■ [1ml0]i|+l+il+l 

z s [K^  T X + € 

-i+1  L R t+1 1 K i+i  J ii+i  + £i+i 


(3.86) 


Also, 


-i+l-i+1  = Ti+lfiiTi+l * 


where 


rrV«  VAi't*iWi^+<!i 

Repeating  the  procedure  described  for  "i=l"  we  find  the  mean- square 
estimation  error  at  time  "1+1"  to  be 


(3.87) 


>r.ce£i+1el+1'.tr.ceR1+1 


h,HK«  *>+*  +r4l^nil+Rl+l)]  1 

+ ^22  ' °21  (nil  + Ri+i  ) 1 r^i 


(3.88) 


Clearly,  to  minimize  trace  ei+1ei+1 ' we  take 


Kf+i 1 Kf+i  + + Ri+i ) 1 “ o 


(3.89) 


The  minimum  attainable  mean-square  estimation  error  at  time  "i+l"  is 
given  by  the  result 
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i 


min  trace  el+1e|+i ' « trace  Ri+i 

+ trace  |f^2  - (f^  + R,+1)  '}  (3 . 90) 

and  this  optimal  result  (3.90)  Is  attained  independent  of  the  particular 
(2) 

choice  of  KJ+1  . Therefore,  at  each  step  n=2, 3,  . . i,  i+1, . . without  loss 
of  generality,  we  may  take  K^  = ln  . 

3.8  EQUIVALENCE  OF  OBSERVER  AND  KALMAN  FILTER  WHEN 

Rj  = 0 

Up  to  this  point  it  has  been  a basic  assumption  that  the  measurement 
noise  be  non-zero  and,  in  fact,  it  was  more  strongly  assumed  that  the 
measurement  noise  covariance,  Rj,  be  positive  definite  at  each  instant  "i." 
This  corresponds  to  the  case  where  each  measurement  component  is 
contaminated  by  an  independent  white  noise  disturbance.  A special  case  of 
particular  interest  is  the  opposite  extreme  where  the  measurements  are 
completely  noise-free,  that  is,  Vj  = 0 for  all  "i."  We  shall  next  treat  this 
important  special  case. 

Rather  loosely  stated,  in  the  absence  of  measurement  noise,  "m" 
of  the  system  states  are  known  exactly  and  it  is  only  necessary  to  estimate 
the  remaining  "n-m"  states.  In  this  particular  situation  it  is  clear  that  the 
Kalman  filter  is  degenerate  ln  the  sense  that  it  reduces  to  an  Mn-m"  dimen- 
sional filter.  Noting  that  the  minimal-order  observer  is  of  dimension  "n-m, " 
one  questions  whether  or  not  in  this  situation  (i.e.,  in  the  absense  of 
measurement  noise)  the  optimal  minimal-order  observer  is  equivalent  to  the 
Kalman  filter  in  the  sense  that  both  filters  provide  identical  mean-square 


estimation  errors.  We  shall  demonstrate  that  this  property  is,  in  fact,  true. 


We  assume  the  system  equations  are  in  the  form 


x<*> 

-i+1 


x<2) 

-i+1 


‘11 


‘21 


‘12 


‘22 


fx0>  1 

-i 


x(2> 

-i 


r*\l) 


w<2> 

-i 


(3.91) 


(3.92) 


For  purposes  of  simplicity  the  plant  noise  covariance  is  assumed  to  be: 


rQ(i) 

i 

0 

0 

q(2) 

(3.93) 


Using  the  Kalman  filter  algorithms  (see  Chapter  1,  equations 
(1.3  ) through  (1.6  ) it  is  easily  verified  that  for  the  system  defined  by 
(3.91),  (3.92)  the  mean-square  error  for  the  Kalman  filter  is 

trace  Pi+1/i+1  = 


trace 


( A* 

l A22*i/i 


' A2/i/i’Ai2'  K/tKj 


(3.94) 


where  the  covariance  Pi+1/i+1  ,s  partitioned  in  tne  form 


Pl+l/i+l 


0 

0 

0 

p<2) 

ri+l/i+l 

(3.95) 


it  is  found  that  the  optimal  observer  estimation  error  is 


(3.96) 


trace 


jfe*  ' A22  + <0  ■ A22-A ' A12 ' (AI2- 


€ ' A*  ‘ 

i-i  12 


A*  € £ ( A 


(3.97) 


Equivalence  of  (3.94)  and  (3.97)  follows  directly  from  the  result  that  in  the 
case  of  no  measurement  noise,  = P^j  . This  result  is  obtained  by 

inspection  oi  the  observer  estimation  error  covariance  e~^eT^ ' and  the 
corresponding  relation  P.+1^.+i  for  the  Kalman  filter. 
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OBSERVERS  FOR  DISCRETE  SYSTEMS  WITH 
GAUSS -MARKOV  NOISE  INPUTS 

4.1  INTRODUCTION 

In  the  previous  chapter  we  have  limited  ourselves  to  estimation 
problems  in  which  the  system  disturbances  were  modeled  as  purely  random 
additive  white  sequences.  Clearly,  in  many  estimation  problems  the  system 
noises  will  be  modeled  more  accurately  as  additive  Gauss-Markov  sequences 
(time-wise  correlated  noise  sequences).  Sequentially  correlated  plant  noises 
can,  in  principle,  be  treated  by  introducing  shaping  filters  driven  by  purely 
random  white  sequences  resulting  in  sequentially  correlated  sequences . [29  ] 
However,  in  the  design  of  the  Kalman  filter  for  systems  with  sequentially 
correlated  noise  inputs  it  is  necessary  to  increase  the  dimension  of  the  state 
vector  to  be  estimated.  This  is  inconvenient  for  real-time  filtering  and, 
equally  important,  the  computation  of  the  Kalman  filter  gains  is  very  likely 
to  be  ill-conditioned.  Thus  it  is  desirable  to  seek  better  ways  to  handle 
sequentially  correlated  plant  disturbances  in  estimation  problems. 

4.2  OBSERVER  DESIGN  FOR  SYSTEMS  WITH  GAUSS-MARKOV  PLANT 

NOISE 

We  shall  now  extend  the  results  of  the  observer  theory  developed  in 
the  previous  chapter  to  the  problem  of  estimation  in  the  presence  of  time- 
wise  correlated  plant  disturbances.  This  problem  shall  be  treated  in  a 
straightforward  manner,  that  is,  the  state  equations  of  the  plant  will  not  be 
augmented  as  must  be  done  in  the  Kalman  filtering  theory.  Taking  this 
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direct  approach  will  result  in  an  observer  of  minimal  dimension.  To  be  more 
precise,  the  dimension  of  the  minimal-order  observer  will  be  the  same  as 
lor  the  case  when  the  plant  noises  are  purely  random  Gaussian  white 
sequences . The  order  of  the  observer  will  therefore  be  independent  of  the 
dimension  of  the  linear  system  required  to  generate  the  Gauss -Markov 
sequence . The  resulting  observer  is  not  designed  to  provide  estimates  of 
the  extra  states  which  model  the  plant  disturbance;  only  the  original  system 
states  arc  estimated.  This  is  highly  desirable  since,  in  practice,  one  usually 
is  only  interested  in  estimating  the  original  system  states.  We  shall  first 
consider  the  problem  of  estimating  the  system  state  vector,  x^,  where  the 
noise  term  is  a Gauss-Markov  sequence. 

Again  we  consider  the  discrete  system 


il+i- Vi  + BiHi+*i 


^l  = H£i  +-i 

The  measurement  noise,  v^ , is  taken  to  be  a Gaussian  white  sequence  with 
covariance 

E l— i— j ' ) * R^i j 

However,  in  the  present  case  we  model  the  plant  disturbance,  w^  as  the  out- 
put of  a linear  discrete  system  driven  by  a zero-mean  Gaussian  white 
sequence.  The  plant  disturbance,  Wj , is  therefore  a zero- mean  Gauss- 
Markov  sequence  generated  as  the  output  of  the  following  system. 

*1+1  “ ri^l  + A (4,3) 

where  Is  a Gaussian  white  sequence.  The  covariance  matrix  of  the  noise 


\ 


vector,  wl+1,  denoted  as  Ql+1,  Is  propagated  sequentially  according  to  the 
relation 

‘WWi'+W  <4-"> 

As  was  done  in  the  previous  chapter,  we  will  design  a minimal  order  observer 
of  the  form 

il+1  " FA+Gliil  + DA  <4*5> 

where  z(  Is  an  (n-m)- dimensional  vector  and 

£i  = TjXj  + Cj  (4.6) 


As  before,  the  observer  error  evolves  according  to  the  recursive  equation 


-l+l  3 Fl-i  + Di-i  * Ti+l-l 


(4.7) 


In  this  case,  from  the  basic  observer  error  equation  (4.7),  we  obtain  the 
observer  error  covariance 


c £ 
-i+l-i+1 


* Vi  ,pi  ' + A,Wi'Ai ' +Q,>  Ti+1 ' 
•Ti+i<Vi5HT+sS'pt'Ai'>Ti+i' 


(4.8) 


In  obtaining  (4.8)  we  have  used  the  results  that  Fj  = T\+jAjPj  atu*  ^ = Ti+lAlV 
At  this  point  it  is  noted  that  the  error  covariance  (4.8)  is  similar  in  form  to 
the  corresponding  expression  obtained  for  the  white  noise  problem  considered 
in  the  previous  chapter  [see  equation  (3.33)  ].  This  suggests  the  possibility  of 
applying  the  same  observer  design  technique  developed  in  the  previous 
chapter  to  the  present  problem  with  sequentially  correlated  plant  noise. 
However,  when  the  plant  noise  is  sequentially  correlated,  the  observer  error 
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covariance  (4,8)  contains  extra  terms  due  to  the  fact  that  the  observer  error 
at  time  "1"  is  correlated  with  the  plant  noise  at  time  "l".  Before  proceeding 
with  the  observer  design  we  shall  digress  momentarily  to  evaluate  the  cross 
correlation  needed  in  the  solution  of  the  observer  error  covariance 

(4.8). 

From  (4.7)  we  have 


£i  = Fi 


l-l 

ifi+  £ 

• j=i 


i-l 

jPl  Fl.  j*1  Tj+1~J  t=2,3,  * 


(4.9) 


where  we  shall  use  the  notation 
A1'1 

Fi  i*  11  Fk 
k-j  k 


and  F,  . ^ I for  all  "i".  Initializing  the  observer  as  described  previously 
**  * 

in  Chapter  3,  the  initial  observer  error  becomes 


il='TlAoVio>‘Tl%) 


(4.10) 


Next,  using  the  relationships 


E[(Xq  - x^w^}  = 0 for  all  "i" 

B{vjWi'}  = 0 for  all  ”1,)” 

One  obtains  the  result 

i-l  

f >=  ‘ jjC  Fi,  j+i  Tj+i  ^j-i ' 1=  1. 2, . . . 


(4.11) 


(4.12) 


From  the  solution  to  (4.3)  which  is 


-i*ri.jVj£)  ri.k+A  1>J 


(4.13) 


one  obtains  the  result 


xjV-XjVV-q/u' 


(4.14) 


where  the  covariance  Qj  Is  obtained  from  (4.4).  Substituting  (4.14)  into 
(4.12)  gives  the  expression 


£i~i  “ jS  Fl.J+*TJ+lQjri.J# 

An  extremely  desirable  property  from  the  standpoint  of  filtering  and 


(4.15) 


processing  of  measurement  data  is  the  recursive  nature  of  the  filtering 
equations  as,  for  example,  in  the  Kalman  filtering  technique.  Although 
(4.15)  characterizes  the  cross  correlation  ' , it  is  not  in  the  desired 
recursive  format.  To  obtain  a recursive  equation  for  ' , consider 
expanding  (4.15)  as  follows 


-l+l  -i+1 # = " jE  Fi+1,  j+1  Tj+lQj  ri+l,j  ' Ti+lQlV  (4*16> 

Using  the  properties  of  the  transition  matrix,  F.  ,,  and  the  fact  that 

lf  J 

Fj  = Ti+iAtPj  it  may  be  shown  that  (4.16)  is  of  the  form 


-i+1  -i+1 ' = Ti+i*AiPi  -i -l ' ' Qp  ri ' 


where 


(4.17) 


Returning  to  the  problem  of  designing  an  optimal  observer  for  the 
system  (4.1),  (4.2),  we  again  assume  without  loss  of  generality  that  the 


measurements  are  of  the  form 

*i*  Clm,0]ii+^i  <4-18> 

Thus,  the  same  observer  structure  used  previously  in  Chapter  3 will  be 
employed  here.  The  observer  output  is  therefore  taken  to  be  following 

2is  [Ki,In-m]ii+^  t4-1*) 

where  again  we  seek  the  optimal  gain  matrix,  K*,  to  minimize  the  overall 
mean  square  estimation  error.  Following  closely  the  approach  of  Chapter  3, 
we  begin  by  partitioning  the  observer  error  covariance  (4.8)  as  follows. 


c c ' = T 
-i+l-i+1  1 i+1 


filll 

*12 

*21 

"22  . 

(4.20) 


where  the  partitions  of  the  matrix  are  conformable  with  the  partitioned 
matrix  Ti+1«  In  the  present  case,  the  matrix  is  defined  by  (4.21)  below. 


r<i 4 Vi  ST  pi  /Ai ' + Wivt  ' V ' + Qi 


AiPi-i^T  ' -iV  Pi  #Ai ' 


(4.21) 


The  next  step  in  the  observer  design  is  to  obtain  the  overall 
estimation  error.  From  this  point  on  the  results  are  essentially  identical 
in  form  to  the  white  noise  case  considered  in  Chapter  3.  Omitting  the 
unnecessary  details,  we  obtain  the  result 
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tr*Ce  ^i+l-l+l*  * tr*ce  Ri+1 

(*.22) 

+tt«:«[K1+1(nll‘+R1+l)ic1+1'+KH.1n12,+aJIlKl+1'+n2Jl) 

Comparison  of  (4.22)  with  (3.47)  of  the  previous  chapter  leads  to  the 
obvious  conclusion  that  the  optimal  gain  matrix  is  identical  in  form  to  that 
obtained  for  the  white  noise  case.  Hence,  the  optimal  gain  matrix  is  given 
by  the  expression 

Kl+1  * "SASl1  + Ri+1>  1 (4.23) 


where  In  the  case  of  a Gauss-Markov  plant  noise  the  computation  of  the 
matrix  is  modified  to  account  for  the  cross  correlation  between  the 
observer  error  Cj , and  the  plant  noise,  wt . 

4.3  OBSERVER  DESIGN  FOR  SYSTEMS  WITH  GAUSS-MARKOV 
MEASUREMENT  NOISE 

Next  we  shall  consider  the  problem  of  sequential  estimation  of  the 
state  vector  x^  of  the  plant  (4*1),  (4.2)  using  a minimal-order  observer  where 
the  measurements  are  corrupted  by  a colored  noise  of  tne  Gauss-Markov 
type . The  plant  noise,  Wj , is  taken  to  be  a Gaussian  white  sequence  with 
covariance 

BtwjWj'J-Qjdy  (4.24) 

However,  here  we  model  the  measurement  noise,  vt,  as  a Gauss-Markov 
sequence  generated  as  the  output  of  the  discrete  system 

*i+l  = 9&  +ii  (*.25) 


52 


Is  a zero* mean  Gaussian  white  sequence.  The  covariance  matrix  of  the 
measurement  noise,  v^,  denoted  as  evolves  with  time  according  to 
the  relation 


ViV 


(4.26) 


We  shall  next  optimize  our  canonical  observer  design  based  upon  the  system 
model  described  above.  From  the  basic  observer  error  equation  (4.7)  and 
the  fact  that  Fj  = Ti+iAt**i  4,1,1  ^ = ^i+iAiVi  11  is  easily  shown  that  the 
observer  error  covariance  is  of  the  form 


' * ti«<Vi55  ' ri  'Ai ' + aivirivi  'V+ <V  T1+i ' 


+ Ti+l<V|i*  VAi  + AtVl  Wl'V>  Tt+l'  (*-27) 


Noting  that  the  observer  error  covariance  (4.27)  is  essentially  in  the  same 
form  as  (4.8),  it  is  clear  that  the  canonical  observer  structure  used 
previously  may  be  again  utilized  for  the  problem  of  colored  measurement 
noise.  Before  proceeding  with  the  observer  design  it  will  be  necessary  to 
obtain  a recursive  solution  to  the  cross -covariance  ' needed  in  the 
evaluation  of  the  observer  error  covariance  (4.27).  From  the  basic  observer 
error  equation  (4.7)  and  the  properties  of  the  noises  w(  and  Vj  [namely  (4.24) 
and  (4.25)]  one  obtains  the  result 

t-1 

-A  = ^ Fi,j+lDj-)V  i=2,3, ...  (4.28) 


Since  the  observer  is  initialized  as  in  (4.10)  we  have  that 


From  the  solution  of  (4.25)  which  is 


where  * 


* * Vj  + 9i.w-i  5*  '*) 

A l_1  A 

. . * n 9.  and  0=1  for  all  "1"  we  obtain  the  result 
*•  J |^sj  * 4f  1 


<«.*)) 


Rj\j' 


and  the  covariance  Rj  is  obtained  from  (4.26). 
gives  the  result 


(4.31) 

Substituting  (4.31)  into  (4. 18) 


-i-i  = jE  Fi+1, j+1  DjRj0i+l, j ' + DlRlfii # <4*33) 

Next  using  the  properties  of  the  transition  matrix  F.  . and  the  relationships 

Fi  = Ti+lAiPi  and  Di  = Ti+lAlVi  it  may  be  shown  that  (4.33)  is  equivalent  to 
the  recursive  expression 


^i+l-i+1 ' ~ Tl+l^AiPi  -i^l ' + AiVlRl)  9i ' 
where  (4.34) 

Without  loss  of  generality  we  shall  again  assume  the  measurements  to  be  of 
the  form  (4.18)  and  take  the  observer  transformation  to  be  of  the  form  (4.19) . 
As  before,  the  observer  design  is  optimized  by  obtaining  the  free  gain 
matrix  Ki+1  which  provides  minimum  overall  mean  square  estimation  error. 
The  matrix  f^,  defined  below,  is  partitioned  as  described  previously 
[see  (4.20)]. 
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mm  ■— ■■ 


fli  * Yi  55 ' pi  'Ai ' + AiviRivi  'Ai ' + Qi 


(4.3S) 


+ YiVt'  VV+Yi^'VV 


where  «i+1£i+1  ' * Ti+1  TJ+1 

Using  (3.38),  (3.44)  the  total  estimation  error  covariance  is  found 

to  be 


-l+l-i+1 


Ll+1 


C v ' - K rt 

-l+l-i+1  Nl+lni+l 


^i+l^i+1 Rl+lKi+l# 


-i+l-i+1 

* ^i+l^i+1  ‘ Kl+1/ 


‘ Ki+1  ^i+l^i+l 


+ Kl+lRl+lKi+l# 


(4.36) 


Before  proceeding  with  the  minimization  of  the  mean  square 
estimation  error  we  shall  rewrite  the  quantity  ' in  a more  useful 


form.  We  partition  (4.34)  into  the  following  form 

It 


-i+l^i+1  " Ti+1 


11 


22 


(4.37) 


where  is  the  upper  m x m dimensional  partition  and  is  the  lower 


(n-m)xm  dimensional  partition.  With  this  definition  it  can  be  shown  that  the 
mean  square  estimation  error  is  given  by 
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l+w+1 


Setting  the  gradient  of  (4.38)  with  respect  to  the  gain  matrix  KJ+1  equal  to 
zero  gives  the  result 


The  minimizing  solution  is  given  by  the  following  expression  [1, 12, 24] 


where  ( ) is  the  Moore-Penrose  pseudoinverse 


SECTION  V 


EXAMPLES  ILLUSTRATING  THE  THEORY 


5. 1 INTRODUCTION 


In  this  chapter  we  shall  illustrate  the  application  and  utility  of  the 
observer  design  techniques  developed  in  the  preceeding  chapters  3 and  4 of 
the  dissertation.  Toward  this  end  we  shall  consider  an  important  practical 
problem,  namely  the  design  of  a radar  tracking  system  (sometimes 
referred  to  as  a track-while-scan  radar  system)  based  upon  the  previously 
developed  theory  of  optimal  minimal-order  observers.  In  particular  we 
treat  two  special  cases  and  these  are  presented  in  the  following  sections  of 
this  chapter  as  examples  1 and  2.  The  purpose  of  these  examples  is  to 
demonstrate  in  a clear  and  straightforward  manner  the  usefulness  of  optimal 
minimal-order  observer  theory  to  an  actual  and  realistic  design  problem.  In 
the  interest  of  simplicity  we  have  selected  target  models  for  our  examples 
which  are  sufficiently  simple  so  that  the  resulting  observer  design  equations 
are  not  too  unwieldy  and  cumbersome.  However,  the  target  models  will  be 
sophisticated  enough  so  that  the  results  of  this  design  study  are  realistic  and 
provide  useful  design  Information  in  a real  tracking  situation. 

In  the  first  example  we  consider  tracking  targets  having  white  noise 
acceleration  inputs,  that  is,  the  target  maneuver  is  a white  noise  sequence. 
The  maneuver,  therefore,  at  one  sampling  period  is  completely  uncorrelated 
with  the  maneuver  at  a different  sampling  period.  This  situation  prevails 
when  the  target  exhibits  constant  velocity  except  for  random  disturbances. 


Also,  the  measurement  errors  are  assumed  to  be  independent  from  measure 
ment  to  measurement.  Typically,  ballistic  missiles,  orbital  and  suborbital 


targets  are  modeled  la  this  way.  Example  1 Is  Inteaded  to  demonstrate  the 
basic  optimal  minimal-order  observer  design  for  systems  having  white  noise 
distrubances  as  treated  In  Chapter  3. 

In  the  sequel  we  shall,  of  course,  compare  the  resulting  performance 
of  the  best  minimal-order  observer  tracking  system  with  the  performance 
obtained  from  the  corresponding  theoretically  optimal  Kalman  filter  tracking 
system.  Also,  In  our  comparative  study  we  shall  Investigate  the  constant 
eigenvalue  observer  designs  of  Dellon  [10]  and  Williams  [32]  and  we  shall 
compare  the  performance  of  these  designs  with  the  best  minimal-order 
observer  design. 

In  the  second  example  we  treat  a slightly  more  sophisticated  (and 
perhaps  more  realistic)  target  model,  namely  the  case  where  target 
acceleration  is  characterized  as  a time -wise  correlated  noise  sequence. 
Physically  speaking,  this  is  interpreted  as  the  situation  where  if  the  target 
being  tracked  is  accelerating  (maneuvering)  at  time  instant  "i"  then  it  is 
also  likely  to  be  accelerating  (maneuvering)  at  the  next  observation  time 
instant  "1+1."  Typically,  manned  maneuvering  targets  such  as  aircraft, 
ships  and  submarines  are  generally  modeled  in  this  way  [27  ].  The 
maneuver  properties  of  a particular  target  are  characterized,  therefore,  by 
two  parameters,  and  these  parameters  are  the  target  maneuver  variance  and 
correlation  time  or  time  constant.  In  the  second  example  we  shall  treat  the 
maneuver  variance  as  constant  and  shall  vary  the  maneuver  correlation  time 
in  parametric  fashion.  Hence  the  resulting  tracking  accuracy  of  the  best 
minimal-order  observer  tracker  and  the  Kalman  tracker  is,  for  the  most 
part,  presented  graphically.  In  this  way  a large  class  of  manned 
maneuvering  targets  Is  considered  and  the  performance  of  the  tracking  system 
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for  any  single  particular  target  Is  obtained  from  the  graphs  by  specifying  Its 
particular  maneuver  properties . The  purpose  of  example  2 Is  to  demonstrate 
the  application  of  our  optimal  minlmal*order  observer  design  technique  for 
the  case  of  systems  with  time-wise  correlated  noise  Inputs  as  discussed  In 
Chapter  4 of  the  dissertation. 

5.2  BXAKVLB  1 

To  illustrate  the  application  of  minimal  order-observer  theory 
in  a practical  design  situation  we  shall  consider  the  following  standard  radar 
tracking  problem.  For  purposes  of  simplicity  we  shall  treat  only  the  special 
case  of  a single  spatial  dimension.  In  particular,  the  target  motion  is 
confined  to  motion  along  the  x-axls  of  the  usual  cartesian  coordinate  axes  and 
the  radar  Is  assumed  to  provide  range  measurements  along  this  same  x-axis. 
Mathematically  the  target  equations  of  motion  for  this  simplified  one- 
dimensional  radar  tracking  situation  are  given  In  state  variable  representation 
by  the  following  [28  ]; 


y4  = Cl  0 0]  ^ + v[ 


*i = Hi*i 

As  Indicated  in  (5.2),  the  position  of  the  target  along  the  x-axis  is 

measured  by  the  ground  radar.  The  measurements  contain  observation  noise 

which  is  represented  by  an  additive  zero- mean  Gaussian  white  sequence,  v , 

2 

having  variance  oy  (measurement  noise  variance).  Practically  speaking,  the 
radar  measurement  error  would  be  range  dependent.  However,  in  this 
simplified  example  we  shall  take  die  variance,  o ' , to  be  constant.  In  (5.1), 
the  input  Wj  represents  the  change  in  target  acceleration  from  time  ”i"  to 
time  "i+1"  and  for  purposes  of  this  example  Wj  is  assumed  to  be  a zero-mean 
Gaussian  white  sequence  with  variance  am  (maneuver  variance) . The  data 
rate,  T,  is  assumed  to  be  constant  so  that  target  position  is  observed  every 
T seconds. 

One  additional  comment  concerning  the  observability  properties  of 
this  system  is  appropriate  at  this  time.  It  is  clear  that  the  system  (5.1), 

(5.2)  (defined  by  the  pair  of  matrices  (A,h))  is  observable  in  the  sense  of 
Kalman  [16].  Checking  the  rank  of  the  observability  matrix  we  obtain  the 
result 


Det  I hA  I = Det  1 


2T  2Ti 


T2/!  I = T‘ 


(5.3) 


Hence  the  system  defined  by  (A,lj)  Is  observable  In  the  usual  sense  for  all 
datu  rates  T > 0 . 

Kalman's  filter  for  the  system  (5.1),  (5.2)  is  a 3-state  filter 
defined  by  the  following  equations: 


a A 

-l+l/l+l  " -1+1/1  + Ki+1  ty+1 


Hi+1  -l+l/l* 


where  Kalman's  gain  matrix  is 


(5.4) 


K 


H 


l+l  1 1+1/1  "t+1  '"1+1  ‘i+l/t  "l+l 


H. 


+ Rl+1> 


(5.5) 


and 

-i+l/l  " Al  -l/i  <5*6> 

The  n-vector  the  minimum  mean  square  estimate  of  x given 

measurements  up-to  and  Including  time  "l+l"  (i.e.,  the  filtered  estimate) 
and  Is  the  minimum  mean  square  estimate  of  xl+i  given  measure- 

ments up-to  und  Including  time  ”1"  (l.e.,  the  one-step-ahead  prediction). 

The  nxn  matrices  Pi+J^+i  and  «r«  the  covariance  matrices  of  the 

filtered  and  one -step -ahead  prediction  errors,  respectively.  These  matrices 
satisfy  the  following  recursive  equations. 


Pl+l/l  " Al  Pi/1  Al  + ^1 
Pl+l/l+l  “ ^n  ’ Ki+1  Hl+P  Pi+l/i 


(5.7) 


Design  of  Kalman's  optimal  linear  filter  is  essentially  complete  at  this  point. 
The  structure  of  the  filter  is  given  in  equations  (5.4)  through  (5.6)  and 
initialization  of  the  filter  ia  performed  in  accordance  with  (5.7), 
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Finally,  following  the  approach  taken  by  Singer  and  Monzingo  [28], 
we  shall  Initialize  the  Kalman  filter  equations  by  taking  as  the  initial  state 
estimate 


*0/0*4  (4  >'o‘Jl,-l  + 4sr-2)  (5-a> 

where  y^,  y.j  and  yQ  are,  respectively,  the  first,  second  and  third  radar 
measurements  received.  The  corresponding  covariance  initialization 
equation  for  (5.8)  is  given  by  the  following: 


' o/o 
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(5.9) 


Since  Kalman's  linear  filter  provides  the  best  attainable 
performance  in  terms  of  minimizing  the  mean-square  estimation  error,  it 
will  provide  us  with  a useful  upper  bound  to  tracking  filter  performance. 
Hence,  our  purpose  in  presenting  the  Kalman  filter  here  is  to  provide  a 
reference  against  whfch  the  performance  of  our  minimal-order  observer  may 
be  compared.  We  shall  next  present  the  design  equations  for  the 
minimal- order  observer. 
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Design  of  the  optimal  minimal-order  observer  lor  the  system 
described  by  (A,h)  is  relatively  straightforward  and  involves  evaluating  the 
design  equations  derived  in  Chapter  3.  We  note  at  this  point  that  the  state 
equations  for  the  system  considered  In  this  example  are  already  in  the 
desired  observer  canonical  form  (that  is,  transformation  of  the  state  equations 
to  a new  coordinate  system  is  unnecessary,  and  therefore  the  basic  design 
equations  of  Chapter  3 apply  without  modification.  For  convenience  we 


tabulate  the  appropriate  design  equations  below. 


V&A-J 


fc]  ’ Vfe] 


(5. 10) 


(5.11) 


(5.12) 


Fi  = A22  + Kl+1  A12 


(5.13) 


Ui  = A21  * A22  Kt  + Kl+1<A11  ‘ A12  K l^ 


(5.14) 


We  shall  present  next  the  solution  to  the  minimal-order 
observer  equations  given  above.  Since  the  system  defined  by  (A.ij)  has  n-3 
state  variables  and  m=l  output  measurement,  the  dimension  of  the  minimal- 
order  observer  is  n*m=2  and  therefore  the  observer  transformation,  Tj, 
satisfies  the  relationship 

il-Tiii+f, 


where 


1 


0 


(5.15) 


Hence,  Tj  is  a 2 x 3 rectangular  matrix  containing  the  arbitrary  gain 
elements  kf  ^ and  k^ . These  arbitrary  gain  elements  are  adjusted  in  an 
adaptive  manner  to  minimize  the  overall  mean*square  estimation  error  at 
each  time  instant  "i."  Computation  of  the  corresponding  and  matrices 
results  in  the  following: 


0 0 


1 0 


0 1 


V = -k^ 
vi  Ki 

.v(2) 


(5.16) 


The  estimate  of  the  state  vector  Xj  is,  of  course,  given  by  the  following 


*»  = Pi5i+Vl*i 


(5.17) 


with  P j and  Vj  as  defined  In  (5.16).  Next,  the  observer  transition  matrix, 
Fj,  is  found  to  be  for  this  example 


k <*> 
i+1 


k <2> 
1+1 


(5.18) 


•i 


(5.19) 

Since  the  three  defining  matrices  (Tj,  F^D^have  been  specified  uniquely  In 
terms  of  the  unknown  adaptive  gain  elements  k ^ and  k^  [see  equations 
(5.15),  (5.18)  and  (5.19)],  design  of  the  basic  observer  structure  is 
essentially  complete.  It  remains  only  to  specify  the  computation  of  the 
optimal  gain  matrix  (that  Is,  the  optimal  gain  elements  k^1}  and  (2)) 
and  to  describe  the  observer  Initialization  technique . 

Determination  of  the  optimal  observer  gain  matrix,  KJ+1,  Is  a 
recursive  procedure  which  uses  the  covariance  matrix 


= ^i ' + V |R|Vj  'A^ ' + Qj . For  the  system  defined  by 

the  state  equations  (5.1),  (5.2)  the  matrix  fij  is  found  to  be 


0 0 0 

0 0 0 

0 0 a 2 


(5.20) 

Cont. 


The  gala  matrix  Kl+1  Is  obtained  from  the  relation  K1+1 

= ^21  ^11  +Ri+P  1 where  °2i  and  nlxl  are  the  appropriate  partitions  of 
the  covariance  ^ and  Rj+j  Is  the  measurement  noise  covariance  at  time  "1+1. ' 
Let  the  observer  error  covarlanc**  be  the  following 
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Vi*  A . 1 
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(5.21) 


and  partition  the  matrix  fij  In  (5.9)  In  the  form 
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(5.22) 


Finally,  the  optimal  gain  elements,  k.  and  k.  ,(2),  can  be  written  In 


closed  form  as  follows 


k <l> 
l+l 


UU,  1 + o 
11  V 


(5.23) 
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(5.25) 


2,(2). 
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Initialization  of  the  observer  requires  the  evaluation  of  the  covariance 
A 

matrix  f.Q  ■ AqMoAo  + Qq  where  for  this  example,  since  Mq  = p , we 
obtain  the  result: 
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(5.26) 

Finally,  the  optimal  initializing  gain  elements,  and  k^2\  are  found  to 


be: 
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5.3  PERFORMANCE  EVALUATION,  EXAMPLE  1 

We  shall  present  next  the  results  of  a comparative  study  of  several 
tracking  system  designs  for  tracking  targets  as  modeled  in  example  1.  Among 
those  tracking  filters  evaluated  are  included  the  Kalman  filter,  the  optimal 
minimal-order  observer,  the  optimal  steady-state  minimal  order  observer, 
and  the  constant  eigenvalue  observer  designs  of  Dellon  [10]  and  Williams  [32], 
A comparison  of  the  tracking  accuracy  for  these  several  tracking  systems 
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is  presented  graphically  in  figures  5.1  through  5.7.  Before  discussing  these 
computer  results,  the  following  descriptive  comments  are  necessary: 

1.  The  optimal  steady-state  minimal-order  observer  is  identical  in 

structure  to  the  optimal  (time -varying)  minimal-order  observer  design 

developed  in  this  dissertation,  with  the  exception  that  the  observer  gain 

matrix  is  constant  and  equal  to  the  steady'state  gain  matrix,  lim  K * , 

i-*® 

obtained  from  the  minimal- order  observer  algorithms. 

2.  Delion's  constant  eigenvalue  observer  design  is  also  identical  in 

structure  to  the  optimal  minimal-order  observer.*  However,  in  this  design 
the  observer  gain  matrix  is  chosen  to  yield  a fixed  time- invariant  observer 
with  two  constant  and  equal  eigenvalues,  Hence,  to  design  a Dellon-type 
observer  for  this  example  it  is  necessary  to  determine  the  observer  gain 
matrix,  K,  such  that  the  observer  F matrix,  where  F = + KAJ2,  has  the 

characteristic  equation  P(^  = (A-^)2  and  ^ is  the  desired  observer  eigen- 
value. This  observer  is  therefore  completely  specified  by  its  eigenvalue, 

The  solution  is  easily  shown  to  be  the  following. 


[T  T/2] 


(5.28) 


*Dellon's  work  is  discussed  in  Section  2.1,  Chapter  2. 
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3.  Williams'  constant  eigenvalue  observer  design  is  identical  in 
structure  to  a Kalman  filter  except  instead  of  implementing  Kalman's 
gain  matrix  the  observer  gain  matrix  is  chosen  to  yield  an  observer  with 
three  constant  and  equal  eigenvalues.*  To  design  a Williams-type  observer 
for  this  example  it  is  necessary  to  determine  the  triple  of  matrices  (T,  F,  D) 
satisfying  the  fundamental  observer  equation  TA  = FT  + DHA  such  that  the 

3 

observer  F matrix  has  the  characteristic  equation  P(A)  = (A-  and  ^ is 
the  desired  observer  eigenvalue.  Hence,  the  Williams1  observer  is  also 
completely  specified  by  its  eigenvalue,  AQ.  For  the  system  (A,  H)  of 
example  1 the  solution  is  found  to  be  the  following. 


r3A  1 0 1 
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-3A 2 0 1 

o 

.A,3  0 0 . 


D = 


*3-3^ 

3^-3 


(5.29) 


*Williams'  work  is  discussed  in  Section  2.2,  Chapter  2. 
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Having  described  each  of  the  observer  designs  considered  in  this 
comparative  study  we  are  now  ready  to  discuss  the  computer  results 
presented  graphically  in  Figures  5.1  through  5.7.  In  this  study,  the  following 
typical  radar  and  target  model  parameters  were  used: 

1.  Radar  range  measurement  accuracy,  o = 10  (ft.) 

2.  Target  maneuver  variance,  ojf  = 100  (ft. /sec.2)2 

3 . Data  Rate,  T = 1 second 

Presented  in  Figures  5.1  and  5.2  is  the  total  mean-square  estimation 
error  versus  the  discrete  time  index  "i"  (that  is,  the  trace  {(Xj-Xj)  • 

(Sl'fj)'}  versus  time  "i”).  Figure  5.1  demonstrates  the  results 
Delion's  design  for  observing  eigenvalues  of  .3,  .4,  .45  and  .5  and  also 
demonstrates  the  results  of  the  Kalman  filter,  the  optimal  observer*  and 
the  optimal  steady-state  observer.  With  reference  to  Figure  5.1,  it  is  clear 
that  the  overall  steady-state  estimation  error  of  the  optimal  observer  is 
increased  from  that  of  the  Kalman  filter  by  approximately  5.9%  whereas  for 
the  best  possible  equal  eigenvalue  design  (^  = .45)  the  corresponding 

•For  the  sake  of  brevity  we  shall  refer  to  the  "optimal  minimal-order 
observer"  as  the  "optimal  observer." 


degredation  is  on  the  order  of  16.5%.  Therefore  it  is  concluded  that  the 
steady-state  performance  of  the  optimal  observer  is  superior,  by  far,  to  the 
uest  equal  eigenvalue  observer  design.  Inspection  of  the  transient  behavior 
also  shows  this  same  general  trend  to  be  true,  as  seen  in  Figure  5.1. 

(Note  also,  in  this  example,  that  the  optimal  steady-state  observer  provides 
excellent  tracking  performance,  not  only  in  the  steady-state  but  during  the 
transient  period  as  well). 

Another  interesting  comment  can  be  made  concerning  the  results  of 
Figure  5.1.  In  viewing  the  results  of  Figure  5.1  it  is  seen  that  the  best 
steady  state  performance  is  achieved  with  = .45,  however  during  the 
transient  period  the  design  with  ^ = .4  performs  best  indicating  that  to  obtain 
acceptable  tracking  performance  (during  both  the  transient  period  and  in  the 
steady-state)  based  on  selection  of  observer  eigenvalues  it  is  perhaps 
necessary  to  select  the  eigenvalue  in  an  adaptive  manner . This  idea  was  first 
proposed  by  Bona  [ 7 ] where  it  was  suggested  that  the  response  time  could  be 
decreased  by  using  one  eigenvalue  during  the  transient  period  and  after  a 
given  time  the  eigenvalue  could  be  increased  to  improve  steady-state  estima- 
tion accuracy. 

Similar  comments  can  be  made  about  the  performance  of  the 
Williams'  3-state  observer  design  as  seen  from  Figure  5.2.  To  achieve  the 
best  steady-state  tracking  performance  in  this  case,  one  takes  the  observer 
eigenvalue  to  be  ^ = .35.  However,  it  is  seen  in  Figure  5.2  that  = .3 
provides  much  better  tracking  accuracy  during  the  transient  period.  In 
regards  to  steady-state  tracking  performance  it  is  seen  that  for  the  best 
eigenvalue  (^  * .35)  the  overall  mean-square  error  is  increased  by 
approximately  10.7%  from  that  of  the  Kalman  filter. 


„ 


i 

Figures  5.3  through  5.7  provide  a breakdown  of  the  overall  mean- 
square  estimation  error  into  target  position,  velocity  and  acceleration  errors. 

Figure  5.3  shows  the  mean-square  error  in  the  position  estimate  versus 
discrete  time  "i"  for  each  of  the  observer  designs  being  evaluated.  Since 
Williams'  observer  is  a 3-state  filter,  it  provides  some  improvement  in  the 
estimate  of  target  position  whereas  the  minimal-order  observer  designs 
(including  the  optimal  observer,  the  optimal  steady-state  observer  and 
Delion's  equal  eigenvalue  observer)  do  not  improve  the  accuracy  in  target 
position.  This  is  no  great  loss  however,  since  even  the  Kalman  filter  only 
improves  the  accuracy  in  target  position  from  its  initial  value  of  10  feet 
r.m.s.  to  approximately  9 feet  r.m.s.  in  the  steady  state.  From  the  stand- 
point of  good  tracking  system  design  this  slight  improvement  in  position 
accuracy  is  hardly  worth  the  effort.  Reduction  in  the  size  of  the  tracking 
filter  from  3 states  to  2 states  will  result  in  significantly  reduced  computer 
processing  requirements  while  yielding  only  a slight  loss  in  position 
accuracy. 

Figures  5.4  and  5.5  present  the  corresponding  mean-square  error  in 
the  estimate  of  target  velocity.  From  these  curves  one  obtains  the  relative 
degredation  in  the  velocity  estimate  (ft ./sec.)  from  that  of  the  Kalman  filter 
to  be,  in  the  steady-state,  3.3%  for  the  optimal  observer,  6.2%  for  the 
Williams  observer  with  A^  = .35  and  11.2%  for  the  Dellon  observer  with 
A^  = .45.  Similar  comments  can  be  made  concerning  the  mean-square 
errors  in  the  estimate  of  target  acceleration  shown  in  Figures  5.6  and  5.7. 
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Mean-Square  Error  in  Position  vs.  Discrete 
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Figure  5.4  Mean-Square  Error  in  Velocity  vs.  Discrete  Time 


Figure  5.5  Mean-Square  Error  in  Velocity  vs.  Discrete  Time 
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Figure  5.6  Mean*Square  Error  in  Acceleration  vs.  Discrete 
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5.4  EXAMPLE  2 


We  shall  next  consider  the  important  problem  of  radar  tracking  of 
manned  maneuvering  targets  as  recently  studied  by  Singer  [27].  in  this 
example  the  target  acceleration  Is  modeled  appropriately  as  a time-wise 
correlated  noise  sequence  of  the  Gauss -Markov  type.  The  fundamental  state 
equations  describing  the  system  in  one  dimension  are  again  given  by  (5.1), 
(5.2).  All  the  basic  definitions  and  assumptions  of  example  1 are  therefore 
assumed  to  hold  with  the  exception  that  In  example  2 the  state  driving  noise, 
w4,  is  taken  to  be  a scalar  Gauss-Markov  sequence.  Hence,  wt  is  obtained 
as  the  output  of  the  discrete-time  linear  system 


Vi  = pwi+^i 


(5.30) 


where  t\  is  a zero -mean  scalar  white  sequence  with  variance  °M2(1'P2)  and 
P is  the  correlation  between  successive  maneuver  samples.  Since  w.  in  (5.30) 
is  a non-white  sequence,  the  Kalman  filter  equations  cannot  be  directly 
applied  and  it  is  necessary  to  "whiten"  the  input  noise  before  the  Kalman 
equations  can  be  used.  The  usual  solution  to  the  "whitening"  approach  is  to 
augment  the  state  equations  (5.1),  (5.2)  using  the  relation  (5.30). 

When  this  is  done  we  obtain  the  following  "augmented"  state  equations. 


yt-  [1  0 0 | 0]  ..  +v,  (5.32) 

*1 


yt(a)  * + vt 

It  is  clear  that  Kalman's  filter  for  the  above  augmented 
system  is  a 4-dimensional  filter  and  to  obtain  the  solution  for  Kalman's 
optimal  weighting  matrix  it  is  necessary  to  solve  recursively  the  augmented 
Kalman  algorithms 
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(5.33) 


(5.34) 


The  superscript  "(a)"  Implies  the  augmented  system  as  defined  in  (5.31), 
(5.32).  In  the  defining  equations  for  the  augmented  Kalman  filter  the  co- 
variance  matrix  for  the  augmented  error  vector  is 


P(a>  = BtfxJ**  - x(a)Hx(a)  - x(a)  ) ' ) 
ri+l/t+l  “ l'=i+l/l+l  -l+l '^1+1/ l+l  -l+l  > J 


(5.35) 
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Using  the  approach  ol  Singer  and  Monzingo  [28]  we  initialize  the 
augmented  Kalman  filter  equations  by  taking  as  the  initial  state  estimate 
for  the  augmented  state  the  following: 


xo/o  = yo 

Vo  *4  (fyo-^-i+iy^ 

x (5-36> 
Vo  = ^2  (yo-^-i+y^ 

Vo  = 0 

where  again  y_2,  y^  and  yQ  are  the  first,  second  and  third  radar  measure- 
ments received.  The  corresponding  covariance  initialization  matrix  for  the 
augmented  filter  is 
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The  two  equations  in  (5.34)  constitute  the  Ricatti  equations  that  must 
he  solved  at  each  discrete  time  instant  to  obtain  the  Kalman  weighting  matrix, 
Ki+1  ’ For  this  simPle  example  the  Kalman  filter  computations  are  increased 
significantly  due  to  the  addition  of  the  extra  state  variable  introduced  by  way 
of  the  augmenting  procedure.  For  example,  Williams  [32]  has  shown  that  the 
number  of  multiplications  or  additions  required  to  solve  the  Kalman  equations 
is  given  by  the  result 

N = 3n^  + 2mn^  + 2m^n  + 2m^  + n^  + 2mn  (5.38) 

where  x.  is  an  n-vector  and  ^ is  an  m-vector.  Whereas  the  non-augmented 
system  (5.1),  (5.2)  originally  required  a total  of  N = 122  multiplications  or 
additions  (since  n=3,  m=l),  the  augmented  system  defined  in  (5.31),  (5.32) 
requires  N=258  multiplications  or  additions  (since  n=4,  m=l).  Clearly  the 
Kalman  filter  computational  requirements  have  been  significantly  increased 
due  to  the  mere  addition  of  a single  state  variable. 

Design  of  the  minimal-order  observer  for  this  example  uses 
directly  the  "non-augmented"  state  equations  (5.1),  (5.2)  together  with  the 
relation  (5.30).  The  design  procedure  is  described  in  detail  in  Chapter  4. 
Since  the  state  equations  (5.1),  (5.2)  are  already  in  the  desired  observer 
canonical  form,  the  basic  observer  structure  for  this  example  is  identical 
with  that  obtained  in  the  previous  example  1.  [See  equations  (5.10)  through 
(5.14).]  However,  computation  of  the  observer  gain  matrix,  K.+1, 
is  modified  appropriately  to  account  for  the  non- zero  cross-correlation 
term  '.  That  is,  the  optimal  gain,  K.+1,  is  obtained  recursively 
using  the  covariance  matrix. 
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where  the  cross -covariance  ^w.  is  computed  recursively  as  £i+”w.+1 ' 

- Tj+1(A^Pi  Jjwj ' - Qp  ' . We  shall  omit  the  unnecessary  details  since  the 
solution  of  the  gain  matrix  K.+1  is  quite  similar  to  that  obtained  previously 
In  example  1 . Using  the  notation  of  the  previous  example  we  obtain  the 
optimal  gain  elements,  and  kj2^  , in  closed  form  as  follows. 
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(5.39) 
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In  obtaining  the  above  results  we  have  used  the  notation 
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(5.42) 


where  for  this  example  only  the  elements  ew^*  and  are  non-zero  and 
propagate  according  to  the  relations 


ew 


ew 


13l+1  - p [k!+l  (TCW13  + T ”23  ) + **13  + T ew23  ] 
23+1=  P[ki+1(2,(T£W13  +T  ^23)  + Gw23*  " am  ] 


(5.43) 


Initialization  of  the  observer  proceeds  as  follows.  The  initial  observer 
error  covariance  matrix  is  of  the  form  ' = Tjf^Tj ' and  it  is  easy  to 
show  that  for  this  example 


f i = A M A ' + A (x  - x ) w ' + w (x  - x ) 'A  ' + Q 
o 000  o'-o  — o — O — O'— o — o o xc 


(5.44) 


where  Mq  = E ((^  - - j^) ')  and ^ is  defined  in  (5.8).  Evaluating  Mc 

yields  the  result 
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Also,  the  cross -covariance  (3^  - wy'  is  found  to  be 
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(5.46) 


Substituting  (5.45)  and  (5.46)  into  (5.44)  yields  the  initialization  matrix  ft  . 


Omitting  the  unnecessary  details,  the  optimal  initializing  gain  elements  k ( 

/'ll  i 


(1) 


(2) 


and  kj  ' are  found  to  be 
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Finally,  the  elements  ew^1  and  given  in  (5.43)  are  initialized  as 


follows: 
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5.5  PERFORMANCE  EVALUATION,  EXAMPLE  2 

In  this  example  we  have  assumed  the  radar  range  measurements  are 

independent  from  sample  to  sample  and  the  accuracy  of  the  range  data  is 

o = 10  ft.  r.m.s.  For  the  target  model  we  have  taken  the  target  maneuver 

2 2.2 

variance  to  be  <J  = 100  (ft. /sec.  ) and  the  maneuver  time  constant 
m 

(correlation)  has  been  varied  in  parametric  fashion.  More  specifically, 
maneuver  correlations  of  0,  .2,  .4,  .6  and  .8  were  evaluated  in  the  study  and 
the  tracking  data  rate,  T,  was  assumed  to  be  1 secbnd.  In  each  case 
considered,  the  tracking  performance  of  the  4-state  Kalman  filter  and  the 
2-state  minimal-order  observer  was  evaluated.  We  shall  next  present  the 
computer  results  shown  graphically  in  Figures  5.8  through  5.11. 

The  total  mean-square  estimation  error  versus  discrete  time  "i"  for 
both  the  Kalman  filter  and  observer  is  shown  in  Figure  5.8.  Note  in  this 
figure  that  we  have  plotted  trace E t(Xj  - Xj)(x.  - x.)'}  versus  "i"  and  there- 
fore the  Kalman  filter  curves  do  not  contain  the  error  contribution  in 
estimating  the  augmented  state  variable,  w^.  Referring  to  Figure  5.8  it  is 
seen  that  the  total  steady-state  mean-square  estimation  error  for  the  observer 
is  increased  from  that  of  the  Kalman  filter  by  5.9%,  5.17%,  5.0%,  6.6%  and 
16.5%  for  target  maneuver  correlations  of  0,  .2,  .4,  .6  and  .8  respectively. 
These  results  indicate  that  the  overall  tracking  performance  is  dependent 
upon  c,  the  maneuver  correlation,  as  is  expected.  From  the  viewpoint  of 
tracking  system  design,  however,  it  is  more  meaningful  to  consider  the 
individual  accuracies  in  target  position  and  velocity  estimates  since  these 
two  quantities  are  the  critical  design  quantities.  For  this  reason  we  have 
shown  in  Figures  5.9  and  5.10,  respectively,  the  mean  square  errors  in 
target  position  and  velocity.  From  Figure  5.9  it  is  seen  that  Kalman  filtering 
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improves  the  initial  measurement  accuracy  of  10  ft.  r.m.s.  to,  at  best, 
about  9 ft.  r .m.s.  in  the  steady  state.  As  stated  previously  in  example  1, 
this  slight  Improvement  in  position  accuracy  is  hardly  worth  the  increase  in 
numerical  and  computational  complexities  associated  with  mechanizing  the 
4- state  Kalman  filter . The  corresponding  mean-square  errors  in  target 
velocity  are  shown  in  Figure  5.10.  From  these  curves  it  is  determined  that 
the  steady-state  accuracy  loss  in  the  velocity  estimate  (ft. /sec.)  incurred 
in  using  the  2-state  observer  instead  of  the  4-state  Kalman  filter  is 
approximately  3.3%,  3.1%,  3.2%,  3.6%  and  6.9%  for  maneuver  correlations 
ofO,  .2,  .4,  .6  and  .8,  respectively.  For  completeness,  we  have  also 
included,  in  Figure  5.11,  the  corresponding  mean-square  error  in  the 
estimate  of  target  acceleration. 

Table  1 shows  the  parametric  behavior  of  the  optimal  observer  gain 
elements,  k^  and  k.^,  versus  discrete  time  "i"  for  each  of  the  maneuver 
correlations  considered.  The  purpose  of  including  Table  I in  this  example 
is  to  point  out  the  time-varying  nature  of  the  optimal  observer  solution  which, 
of  course,  is  also  a fundamental  property  of  the  Kalman  filter.  After  an 
initial  transient  period,  the  error  covariance  matrices  settle  down  and  remain 
constant  and  likewise  the  corresponding  optimal  observer  gain  elements 
remain  constant.  This  same  phenomenon  occurs  in  Kalman  filtering  theory 
for  problems  where  the  system  matrices  (A,  H)  are  time -invariant  and  the 
noise  inputs  are  stationary  stochastic  sequences.  In  examining  Table  1 it 
is  interesting  to  note  that,  generally  speaking,  the  magnitude  of  the  observer 
gain  increases  as  the  correlation  increases  from  p = 0 to  P = .8.  Also, 
from  Table  1 it  is  seen  that  the  observer  settling  time  tends  to  increase  as 
the  maneuver  time  constant  increases . The  settling  time  of  the  observer 
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is  comparable,  however,  with  that  of  the  Kalman  filter,  as  can  be  seen 
in  Figures  3.8  through  5.11. 


Figure  5.8  Total  Mean-Square  Estimation  Error  vs.  Time  "i 


Figure  S.10  Mean-Square  Error  in  Velocity  vs.  Time  "l," 
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Figure  5.11  Mean-Square  Error  in  Acceleration  vs.  Time  "l 


Table  5.1.  Observer  Gains  k.'  ' and  k*  ' Versus 
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SUMMARY  AND  SUGGESTIONS  FOR  FURTHER  WORK 


6. 1 SUMMARY  AND  CONCLUSIONS 

This  dissertation  has  considered  the  prohlem  of  estimating  the  state 
of  a linear  time-varying  discrete  system  using  an  observer  of  minimum 
dynamic  order.  In  Chapter  3 of  the  dissertation  we  consider  systems  for 
which  the  plant  noise  w^  and  measurement  noise  Vj  are  modeled  as 
Gaussian  white  sequences.  The  effects  of  these  noise  disturbances  upon  the 
estimation  error  are  considered  as  an  integral  part  of  the  fundamental 
development . The  solution  of  the  observer  design  uses  a special  linear 
transformation  which  transforms  the  given  state  equations  into  an  equivalent 
state  space  which  is  extremely  convenient  from  the  standpoint  of  observer 
design.  Design  of  the  observer  is  then  based  on  a special  observer  config- 
uration containing  a free  gain  matrix,  Kj,  which  is  chosen  to  minimize  the 
mean-square  estimation  error  at  time  "l."  The  solution  obtained  is  optimal 
at  each  instant  'T'  and  therefore  is  optimal  both  during  the  transient  period 
and  in  the  steady  state.  Computation  of  this  gain  matrix  is  done 
recursively  as  in  the  Kalman  filter  algorithms,  however,  computationally  the 
solution  is  much  simpler  than  for  the  Kalman  filter.  In  the  special  case  of 
no  measurement  noise,  the  observer  estimation  errors  are  identical  with 
that  of  the  corresponding  Kalman  filter.  The  main  contribution  of  Chapter  3 
is,  therefore,  the  development  of  a completely  unified  theory  for  the  design 
of  optimal  minimal-order  observers  applicable  to  both  time-varying  and  time- 
invariant  discrete  systems  for  which  the  plant  noise  w4  and  measurement 
noise  vt  arc  modeled  as  Gaussian  white  sequences. 
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In  Chapter  4 we  have  extended  the  basic  optimal  minimal-order 
observer  theory  to  cover  that  class  of  systems  for  which  the  noise 
disturbances  Wj,  are  time-wise  correlated  and  are  modeled  adequately  as 
Gauss -Markov  processes.  The  usual  approach  to  this  estimation  problem 
is  to  augment  the  state  vector  and  design  the  estimator  (be  it  a Kalman  filter, 
observer,  etc.)  to  provide  estimates  of  the  total  augmented  state.  In 
Chapter  4 we  have  utilized  the  basic  observer  structure  developed  in  Chapter  3 
and  have  modified  the  observer  gain  matrix  appropriately  to  obtain  minimum 
mean-square  estimates  of  the  plant  states  without  an  increase  in  the 
dimension  of  the  observer  (i.e.,  the  observer  dimension  remains  "n-m"). 
Along  similar  lines,  we  have  also  considered  the  special  case  whereby  the 
plant  noises  w^  and  v.  are  white  sequences  which  are  crosscorrelated  at 
time  "i"  (that  is,  E ' J = S.d.^)  and  have  modified  the  observer  gain 
matrix  appropriately  to  provide  optimal  performance  in  the  mean-square 
sense . 

To  illustrate  the  typical  application  of  the  observer  designs  developed 
in  this  dissertation  we  have  considered,  in  Chapter  5,  the  design  of  a radar 
tracking  system.  In  the  first  example  we  treat  the  situation  where  the  noises 
Wj  and  v.  are  white  sequences . In  this  example,  the  performance  of  the 
optimal  minimal-order  observer  is  compared  with  that  of  other  estimators 
including  the  Kalman  filter  and  also  several  equal-eigenvalue  observer 
designs.  It  is  shown  that  for  a typical  set  of  radar  and  target  model  para- 
meters the  optimal  observer  provides  extemely  good  tracking  performance  and 
is  superior  by  far  to  the  equal  eigenvalue  designs  of  Dellon  [10]  and 
Williams  [323.  In  example  2 we  treat  the  situation  where  the  target 
acceleration  is  modeled  as  a time-wise  correlated  noise  sequence.  Here  the 


2 -dimensional  optimal  observer  is  compared  with  the  corresponding  4- state 
Kalman  filter  and  it  is  shown  that  the  observer  provides  acceptable  tracking 
performance  over  a wide  spectrum  of  target  maneuver  time  constants.  The 
examples  of  Chapter  5 clearly  illustrate  the  practicality  of  the  observer 
design  techniques  developed  in  the  dissertation. 

6.2  TOPICS  FOR  FUTURE  INVESTIGATION 

During  the  course  of  performing  this  research  several  closely 
associated  unsolved  problems  of  an  extremely  fundamental  nature  have  been 
uncovered  and  these  prohlems  might  form  the  basis  for  further  research.  In 
this  dissertation  we  have  considered  only  observers  of  minimal  dynamic 
order.  That  is,  the  dimension  of  the  dynamical  portion  of  the  estimator  is 
”n-m"  where  "n"  is  the  dimension  of  the  state  vector  to  be  estimated  and  "m" 
is  the  number  of  independent  available  outputs . Since  it  has  been  demonstrated 
quite  vividly  that  the  Kalman  filter  is  an  observer  of  dimension  Mn"  and  since 
the  Kalman  filter  provides  the  best  performance  in  terms  of  minimizing  the 
mean-square  estimation  error,  the  idea  of  considering  non-minimal  order 
observers  is  appealing.  (A  non-minimal  order  observer  has  dynamic  order 
greater  than  the  minimal  order  observer  but  less  than  the  Kalman  filter.) 

It  is  conjectured  that  through  the  use  of  non-minimal  order  observers 
the  estimation  error  can  be  reduced  even  further  from  that  attained  with 
the  optimal  minimal-order  observer  developed  in  this  dissertation.  However, 
the  improvement  in  estimation  accuracy  is  undoubtedly  accomplished  only  at 
the-  cost  of  increased  complexity.  This  non-minimal  order  observer  would 
have  important  application  in  the  class  of  systems  where  some  of  the  outputs 
are  relatively  noise- free  while  the  remaining  outputs  are  rather  noisy  and 
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must  be  filtered.  In  thin  proposed  domain  of  research  the  literature  is 
completely  lacking  and  therefore  it  is  recommended  that  further  work  be  done 
along  these  lines. 

Another  area  of  research  which  appears  to  be  relatively  void  of 
investigation  is  in  the  area  of  super  low-order  observers.  When  an  estimate 
of  some  fixed  linear  combination  of  states  is  required,  it  is  well  known  [21] 
that  such  an  estimate  can  be  obtained  using  an  observer  of  order  less  than 
the  minimal  order,  "n-m.”  A consideration  of  the  effects  of  system  noise 
inputs  upon  the  performance  of  these  so  called  super  low-order  observers 
may  lead  to  an  optimal  design  similar  to  the  optimal  minimal-order  observer 
developed  in  this  dissertation. 

Another  possible  topic  for  future  research  of  a more  practical  nature 
is  the  design  of  observers  via  the  selection  of  observer  eigenvalues.  To 
date,  most  of  the  literature  pertaining  to  the  design  and  optimization  of 
observer  systems  has  been  concerned  with  the  ability  to  specify,  with 
complete  freedom,  the  choice  of  observer  eigenvalues.  In  fact,  numerous 
researchers  have  been  able  to  demonstrate  through  the  clever  use  of  special 
canonical  forms  that  it  is  possible  to  design  observers  with  completely 
arbitrary  eigenvalues  provided  the  plant  equations  satisfy  the  observability 
criterion.  However,  it  is  clear  that  without  a thorough  analysis  of  the 
effects  of  noise  the  question  of  where  to  optimally  place  the  observer  eigen- 
values for  reasonable  performance  is  still  unanswered  and  remains  a per- 
plexing problem  to  the  systems  designer.  It  Is  one  thing  to  be  able  to  design 
observer  systems  with  complete  freedom  in  the  choice  of  observer  eigen- 
values, but  It  Is  another  to  be  able  to  specify  what  the  eigenvalues  should  be. 
Very  little  has  been  written  about  this  latter  aspect. 


99 


In  the  design  of  an  observer  for  any  given  fixed  plant,  one  possible 
approach  to  this  eigenvalue  selection  problem  might  be  to  first  investigate 
the  eigenvalues  of  the  corresponding  K alman  filter  in  order  to  establish  some 
guidelines  for  selecting  the  observer  eigenvalues.  In  restricting  the  class  of 
admissible  observers  to  be  investigated,  some  fundamental  rules  might  be 
developed  for  the  optimal  choice  of  observer  eigenvalues . Results  of  a 
fundamental  nature  are  also  lacking  in  the  domain  of  adaptive  observer  design 
wherein  the  choice  of  observer  eigenvalues  is  modified  with  time  in  an 
optimal  fashion  according  to  the  noise  statistics,  signal  to  noise  ratio,  or 
some  other  criterion.  Much  research  remains  to  be  done  in  the  domain  of 
observer  eigenvalue  selection  where  the  minimization  of  noise  effects  upon 
system  performance  is  of  prime  importance. 

Finally,  It  should  be  mentioned  that  the  design  of  the  optimal  minimal- 
order  observer  for  time-varying  continuous-time  systems  is  still  an  unsolved 
problem.  This  problem  was  investigated  by  Ash  [4V5]  who  considered  the 
design  of  a minimal-order  observer  for  continuous  time-varying  linear 
systems  (i.e.,  the  continuous  time  analog  of  the  discrete-time  problem 
treated  in  this  dissertation)  with  the  goal  of  obtaining  an  observer  design 
which  minimized  the  effects  of  noise  upon  the  estimation  accuracy  of  the 
observer  derived  estimates.  Ash  proposed  a suboptimal  trial-and-error-type 
solution  to  the  problem  and  hence  the  results  of  his  work  are  an  "engineering" 
rather  than  a "mathematical"  solution  to  the  design  problem.  He  was  unable  to 
select  the  free  gain  matrix  K(t)  (analogous  to  the  free  gain  matrix  Ki  of  the 
discrete  observer)  to  absolutely  minimize  the  overall-mean- square 
estimation  error.  It  is  conjectured  that  an  optimal-observer  gain  matrix, 

K*(t),  does  exist  for  the  continuous  time-varying  minimal-order  observer 
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and  the  solution  of  this  problem  would  be  an  Important  contribution  to  the 
theory . 


One  possible  approach  to  the  solution  of  this  problem  might  be  to 
discretize  the  continuous  time-varying  state  equations  obtaining  a model  for 
the  plant  which  is  valid  at  discrete  intervals  At  seconds  apart.  Then  the 
theory  developed  in  this  dissertation  for  discrete-time  systems  may  be 
applied  to  the  discrete  representation  of  the  plant  and  the  optimal  discrete 
minimal-order  observer  derived.  Taking  the  sample  interval  At  sufficiently 
small  one  would  obtain  a reasonably  good  approximation  to  the  continuous 
time  problem.  Of  course,  it  is  of  interest  to  obtain  a closed  form  solution 
for  the  optimal  observer  gain  K*(t)  analogous  to  the  gain  of  the  discrete 
time  observer.  In  [15]  Kalman  was  ahle  to  obtain  the  continuous -time 
Kalman  filter  solution  from  a consideration  of  the  discretized  model  by 
taking  the  limit  as  At  - 0.  But  even  Kalman  himself  questioned  the  rigor  of 
this  approach  and  in  [18]  Kalman  took  a more  rigorous  approach  and  solved 
the  Wiener -Hopf  equation  directly  to  obtain  the  continuous  time  version  of 
the  Kalman  filter.  It  is  recommended  that  further  work  be  done  in  the  area  of 
minimal-order  observer  design  for  continuous -time  equations  with  the  goal  of 
determining  the  optimal  time- varying  solution. 
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